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I.  INTRODUCTION 

Frequently  it  is  of  interest  to  digitally  filter  out  narrowband  signals  which  are 
embedded  in  additive  broadband  noise.  This  filtering  can  often  be  accomplished  using 
fixed  bandpass  digital  filters  (e.g.,  [1])  provided  the  center  frequencies  of  the  signals  and 
their  bandwidths  are  known,  a priori,  and  do  not  change  with  time.  In  many  cases  of 
practical  interest,  however,  such  a priori  information  docs  not  exist  and  alternate  filtering 
schemes  must  be  employed . 

When  the  signals  and  noise  can  be  considered  as  random  processes  with  given  cross- 
correlation and  autocorrelation  functions,  Wiener  filtering  techniques  are  often  effective. 

The  design  of  Wiener  filters  requires  that  the  signal  and  noise  be  stationary  and  that  the 
various  crosscorrelation  and  autocorrelation  functions  be  known  a priori  [2] . Wiener  filters 
have  a wide  range  of  applications,  however,  because  the  required  statistics  may  be  estimated 
directly  from  the  data  thereby  alleviating  the  need  for  a priori  knowledge  of  such  parameters 
as  the  signal  frequencies. 

The  design  of  adaptive  filters  which  continuously  estimate  the  Wiener  filter  coeffi- 
cients has  been  considered  by  a number  of  authors.  The  various  adaptive  estimation  tech- 
niques include  the  pioneering  work  of  Widrow  who  developed  the  least  mean  square  (LMS) 
adaptive  filter  in  References  [3-5]  which  employs  a noisy  gradient  algorithm.  Alternatives  to  the 
LMS  algorithm  have  also  been  developed  in  References  [6-10]  and  a more  complete  discussion 
of  some  of  the  various  adaptive  implementations  of  Wiener  filters  and  their  applications  is 
given  in  Reference  [11].  It  should  be  noted  that  adaptive  Wiener  filters  have  found  a number 
of  noise  cancellation  applications  in  such  areas  as  medicine  [51 , adaptive  line  enhancement 
[12,  291 , and  speech  processing  [ 131 . Other  areas  of  application  of  adaptive  Wiener  filters 
include  predictive  deconvolution  [37] , acoustic  Doppler  extraction  [38] , and  real  time 
linear  prediction  [36]. 

In  many  applications  of  Wiener  filtering  to  noise  cancellation,  an  external  reference 
input  is  used  [5] . This  external  reference  input  should  consist  of  noise  which  is  uncorrelated 
with  the  signal  and  highly  correlated  with  the  additive  noise  corruption  in  order  for  the 
Wiener  filter  to  effectively  cancel  the  additive  noise.  In  applications  where  an  external  refer- 
ence for  the  additive  noise  is  not  available,  it  is  possible  to  cancel  the  additive  noise  using  a 
Wiener  linear  prediction  filter  (LPF)  if  the  signal  bandwidth  is  significantly  less  than  the 
bandwidth  of  the  additive  noise. 

A schematic  diagram  of  a finite  impulse  response  (FIR)  Wiener  LPF  is  illustrated  in 

Figure  1.  The  impulse  response,  w*(k)  (k  = 0 L - 1),  is  chosen  to  minimize  the  power 

in  the  error  signal  e(j),  and  the  delay,  A,  represents  the  prediction  distance  of  the  filter.  The 
noise  suppression  capabilities  of  the  discrete  LPF  arise  from  the  fact  that  the  decorrelation 
time  for  broadband  noise  is  smaller  than  that  for  the  narrowband  signals.  Therefore,  it  may 
be  possible  to  choose  a value  for  A which  will  effectively  decorrelate  the  broadband  noise 
and  prevent  the  noise  components  from  appearing  in  the  LPF  output  (y(j)  in  Figure  1). 

The  application  of  LPF  techniques  to  noise  suppression  presents  a number  of  funda- 
mental questions  regarding,  e.g.,  the  values  of  A and  L required  for  the  maximum  amount  of 
noise  reduction  without  appreciable  signal  distortion.  The  elimination  of  signal  distortion  is 
particularly  relevant  to  the  application  of  LPF  methods  to  speech  enhancement  [ 13] . This 
report  will  provide  an  analytical  basis  for  bounding  the  performance  of  digital  linear  predic- 
tion filters  for  input  data  consisting  of  narrowband  signals  embedded  in  additive  broadband 
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Figure  1.  Linear  prediction  Wiener  filter. 

noise.  Specifically,  the  impulse  response  and  transfer  function  of  a theoretical,  discrete  Wiener 
LPF  will  be  examined. t 

Analytic  expressions  for  the  LPF  impulse  response  when  the  input  sequence,  xG),  is 
stationary  and  the  z-transform  of  the  autocorrelation  function  of  x is  a rational  function  of  z 
will  be  developed  in  Section  II.  The  special  case  of  narrowband  signals  embedded  in  additive 
broadband  noise  will  be  treated  in  detail  in  Section  III.  Specifically,  a rational  spectral  density 
model  will  first  be  developed  to  approximate  the  power  spectrum  of  the  narrowband  signals 
plus  noise.  Then,  using  the  results  of  Section  II,  the  discrete  LPF  impulse  response  will  be 
derived.  The  limiting  cases  of  all  pole  noise  (no  signals)  and  sinusoids  in  additive  noise  will  be 
examined.tt  Finally,  in  Section  IV,  results  of  experimental  simulations  of  an  adaptive  imple- 
mentation of  the  LPF  will  be  presented  and  discussed. 


HIM 


II.  PROPERTIES  OF  THE  DIGITAL  WIENER  PREDICTION  FILTER 
FOR  INPUTS  WITH  RATIONAL  POWER  SPECTRA 


I 


i 


The  properties  of  the  LPF  structure  discussed  in  this  section  are  derived  using  discrete 
Wiener  filter  theory  [14-1 6] . A number  of  other  interesting  properties  of  linear  prediction 
filters,  a discussion  of  their  applications  to  a number  of  different  fields,  and  an  extensive  bib- 
liography can  be  found  in  the  excellent  review  articles  by  Makhoul  [17]  and  Kailath  [ 18] , as 
well  as  in  the  book  by  Markel  and  Gray  [34] . 

Referring  to  Figure  1 , the  Wiener  filter  coefficients,  w*(k)  (k  = 0,  1 L — 1 ), 

which  minimize  the  power  in  the  error  sequence,  e(j),  satisfy  the  following  set  of  linear  equa- 
tions (e.g.,  [17,  20]): 

L-l 

^ 0xx(8-k)w*(k)  = 0xx(8  + A)  8 = 0,  1 , . . . , L - 1,  (1) 

k=0 

where  0xx(k)  represents  the  discrete  autocorrelation  function  of  x(j)  and  is  given  by 
<£xx(k)  = E[x(j)  x(j  + k)]  where  E[  * ] denotes  expectation.  Equation  (1)  represents  the  dis- 
crete analog  of  the  integral  equation  derived  in  Reference  [ 19]  for  the  continuous,  finite  dura- 
tion Wiener  filter. 

Our  analysis  will  be  restricted  to  the  case  when  the  z transform  of  0xx(k),  i.e., 

OO 

sxx(z>=  2 «xx<k>z"k-  (2) 

k=-oo 

is  a rational  function  of  z.  There  are  two  reasons  for  this.  First,  for  this  important  case, 

Eq.  (1)  can  be  solved  by  elementary  methods  and  its  solution  provides  insight  into  the  ana- 
lytic structure  of  the  LPF.  Second,  the  special  case  of  Sxx(z)  being  rational  provides  a good 
description  of  a much  broader  class  of  stationary  random  inputs  since  any  analytic  function 
may  be  closely  approximated  by  a rational  functu.  In  particular,  as  will  be  discussed  in  the 
next  section,  relatively  simple  rational  power  spectrum  models  can  be  developed  to  describe 
an  important  class  of  inputs,  i.e.,  narrowband  signals  and  additive  broadband  noise. 

Therefore,  we  shall  write  Sxx(z)  as 

M 

| | (z  - + J^m)  (z_1  -e'^m  -j^m) 

Sxx(z)  = A ^ , (3) 

r>  _ e-0!!  + i^n)  (z~l  -e^n'j^n) 

n=l 

where  the  and  a„  are  non-zero,  positive  real  constants  and 
-w  < oin,6m  <#,  for  all  m,  n. 

Also,  in  Eq.  (3)  A is  a real,  positive  constant  and  an  overbar  denotes  complex  conjugation. 

The  expansion  in  Eq.  (3)  with  z * exp  (jw)  (-»<«<  »)  represents  the  power  spectrum  of  a 
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complex  process.  For  a real  process,  the  zeroes  and  poles  of  SXx(z)  will  either  be  real  or 
appear  in  complex  conjugate  pairs.  Therefore,  the  expansion  in  Eq.  (3)  is  more  general  than 
that  for  a real  process  and  will  prove  useful  in  the  later  sections.t 

In  this  report,  we  will  explicitly  treat  the  case  of  M < N.  The  case  of  M > N can  be 
treated  by  a straightforward  extension  of  the  methods  discussed  here.  As  shown  in  Appen- 
dices A and  B,  when  M < N,  w*(k)  can  be  represented  as  follows  [Appendix  A,  Eq.  (A-l  9) J : 

M 

w*(k)=  ^ |b+  e-^mk+j^mk  + B^e-^L- 1 -k)+jdmkj 

m=l 


N-M 

+ X (cr  6(k_r+ ,)  + Cr  6(k  + r-L)j  k = 0,  1, . . . , L - 1,  (4) 


where  6(k)  is  the  Kronecker  delta  function,  i.e.,  6(k)  = 0 for  k =£  0 and  6(0)  = 1 . The  con- 
stants and  Cj:  may  be  obtained  by  solving  the  following  set  of  linear  equations  [Appen- 
dix B,  Eq.  (B-l  2)] . 


2 


m=l 


1 _ ean  ~ Mm  ~)(^n  ~ ^m) 


Bm  e"Mm(L" 

1 _ ean  + Mm  "j(un  - ^m) 


and. 


N-M 

^ c+ean(r- l)-jwn(r- l)  = e-«n^+jwnA 
r=l 


n = 1 N; 


M 

l 


B+ 
Dm  c 


Bj^  + J^mL 


1 _ e^n  “Mm  “j(^n  “ ^m)  j - e-0^  + Mm  " j(wn  “ ®m) 


N-M 

"2  Cpeanr+jwnr=:0  n = l,...,N. 
T^l 


(5) 


(6) 


The  solution  of  Eqs.  (5)  and  (6),  together  with  (4)  provides  the  complete  solution  for  w*(k) 
when  M < N.  The  only  modification  which  is  needed  when  M = N is  to  remove  the  summa- 
tion terms  involving  the  delta  functions  in  Eq.  (4)  and  the  summation  terms  involving  the  C* 
in  Eqs.  (5)  and  (6).  That  is,  when  M = N only  damped  exponentials  appear  in  the  analytic 
solution  for  the  LPF  coefficients,  w*(k). 


A number  of  interesting  properties  of  the  FIR  linear  prediction  filter  may  be  noted 
from  Eqs.  (4)  through  (6).  First,  it  is  seen  from  Eq.  (4)  that  w*(k)  consists  of  sums  of 
damped  exponentials,  exp  (±/xmk  + J ®mk).  as  well  as  impulses.  It  is  further  seen  that  the 
exponentials,  which  are  the  zeroes  of  Sxx(z),  decay  away  from  each  end  of  the  filter  with  the 


^ It  should  be  noted  that  if  x(j)  is  a complex  process,  then  w*(k)  will  still  be  given  by  ( 1 ) but  0xx(k)  would 
be  given  by:  tfjcxOO  * E [x(JF  x0  ♦ k)J . 
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and  Bj^  representing  the  amplitudes  of  the  damped  exponentials  which  decay  from  the 
beginning  and  end  of  the  filter,  respectively.  Likewise,  the  C*  and  C~  represent  the  ampli- 
tudes of  the  impulses  which  occur  at  the  beginning  and  end  of  the  filter,  respectively.  There- 
fore, the  constants  associated  with  the  superscripts  can  be  thought  of  as  reflection  ampli- 
tudes which  are  the  direct  result  of  the  finite  filter  length.  From  Eq.  (5)  it  is  seen  that  the 
Bj^  couple  into  the  N equations  for  the  Bjlj,  and  C*  through  coupling  coefficients  which  are 
proportional  to  exp  (-/im L).  Vice  versa,  from  Eq.  (6)  it  is  seen  that  the  B^  couple  into  the 
N equations  for  the  B^  and  C”  (the  reflection  amplitudes)  through  coupling  coefficients 
which  are  also  proportional  to  exp  ( MmL).  As  L -*■  °°,  these  coupling  coefficients  approach 
zero  and  from  (6),  the  reflection  amplitudes,  Bj^  and  C~  also  approach  zero.  Therefore,  as 
L -*•  <»,  i.e.,  as  exp  (-MmU  “*■  0.  the  reflection  amplitudes  approach  zero  and  w*(k)  can  be 
represented  as  a sum  of  damped  exponentials  and  impulses  all  of  which  occur  at  the  begin- 
ning of  the  filter.  It  should  be  noted  that  the  reflection  amplitudes,  BJ^  and  C“,  are  similar 
to  the  reflection  coefficients,  Km,  which  appear  in  the  Levinson-Durbin  algorithm  [17).  In 
fact,  the  Km  may  be  related  to  all  the  amplitudes,  Bj^  and  Cjr,  through  the  relation  [17]: 


Kp  = w (p), 


(7) 


with  p = L - 1 in  Eq.  (4).  As  is  the  case  with  the  reflection  amplitudes,  it  is  seen  from  Eqs. 
(4)  through  (7)  that  the  reflection  coefficients  also  decay  to  zero  as  the  filter  length  becomes 
infinite. 

Equation  (4)  also  enables  one  to  write  an  explicit  relation  for  the  frequency  response, 
h£( cj),  of  the  discrete  LPF  in  terms  of  the  Bj^,  Cjr: 

L-l  M 

H^oi)  = w*(k)  e-j^k  + 1 ) = e-jw  ^ 


k=0 


m=l 


+ i _ e'MmL  + j(0m  - w)L 


+ Bme 


-Mm(L-l)  l7e^j(^m-co))L 


1 _ e(Pm  + j(0m  " w)) 

+ e“jw  ^ (c+e-)^-  ')  -»-  C-e-J^1-  " r>}  . 


N-M 


(8) 


r=l 


As  Mm L -*•  °°,  BJ^,  CjT,  and  exp  (-pmL)  -►  0 and  HL(<*>)  approaches: 


M 


lim  hJtw)  = H^(cj)  = 


Bl  e“Jw 
m 


1 - e~^m  + j(®m  “ w) 


m=l 


N-M 


♦ S <?■ 

r*l 


-jwr 


(9) 


Note  that  from  Eq.  (9),  IH^w)!  will  tend  to  have  peaks  at  the  angular  frequencies,  0m,  of 
the  zeroes  of  SXx(z)-  This  result  is  consistent  with  the  “whitening”  filter  interpretation  of  an 
LPF  (with  A = 1 ).  This  interpretation  (e.g.,  1 1 7] , [ 1 8] , [23] ) states  that  as  L becomes  large, 
the  power  spectrum  of  the  LPF  error  output,  e(j)  in  Figure  1,  will  become  approximately  flat 
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when  A = 1.  Therefore,  since  the  input  spectrum  has  depressions  at  the  angular  frequencies 
of  the  zeroes  of  Sxx(z)>  then  the  magnitude  squared  of  the  transfer  function  between  e and  x, 
i.e.,  |1  - Hl(w)|2,  should  have  peaks  at  the  angular  frequencies  of  the  zeroes  of  SXx(z)-  This, 
of  course,  implies  that  IHjJoj)!  will  also  tend  to  have  peaks  at  the  angular  frequencies  of  the 
zeroes  of  SXx(z)-  I*  should  be  pointed  out  that  although  the  “whitening”  filter  argument 
only  applies  when  A = 1 , it  does  provide  an  indication  of  the  behavior  of  | H l( co ) | near  the 
angular  frequencies  of  the  zeroes  of  SXx(z)  even  when  A > 1 . (Indeed,  A only  enters  into 
the  expression  for  |Hl(co)|  through  the  scaling  factors,  e-an^  + jwnA  appear  Qn  the 

right-hand  side  of  Eq.  (5).)  When  A = 1 and  gmL  555  0 (for  any  m),  the  LPF  cannot  com- 
pletely whiten  the  input  spectrum  due  to  the  interaction  between  the  “+”  and  coeffi- 
cients in  Eqs.  (5)  and  (6). 

$ 

Equations  (4)  through  (9)  provide  a simplified  method  for  obtaining  w (k)  and 
H^co)  in  terms  of  the  poles  and  zeroes  of  Sxx(z)-  (Note  that  the  dimensionality  of  these 
equations  is  determined  by  N and  M and  is  independent  of  L and  A.)  For  many  applications 
this  formulation  allows  L and  A to  be  treated  as  adjustable  design  parameters  which  can  be 
optimized  on  the  basis  of  desired  performance  criteria  (e.g.,  [ 1 2] , [ 21  ] ).  One  of  the  main 
difficulties  in  applying  the  above  results  is  obtaining  an  appropriate,  simple  pole-zero  model 
for  the  input.  This  particular  problem  will  be  addressed  in  the  next  section. 


III.  LPF  ANALYSIS  FOR  INPUTS  CONSISTING  OF  NARROWBAND 
PROCESSES  AND  ADDITIVE  BROADBAND  NOISE 


DETERMINATION  OF  APPROPRIATE  POLE-ZERO  MODELS  FOR  NARROWBAND 
PROCESSES  IN  ADDITIVE  BROADBAND  NOISE 

A representative  model  for  a sum  of  bandpass  processes  embedded  in  additive  broad- 
band noise  may  be  expressed  by  the  following  autocorrelation  function: 

N 

0Xx(k)  = 0no(k)  + ^ °n  e_an  |k|  cos  wnk.  (1 0) 

n=l 

2 

In  Eq.  ( 1 0),  o£,  an,  and  con  represent  the  power,  3-dB  half  bandwidth,  and  frequency,  respec- 
tively, of  the  nth  signal  and  0no(k)  represents  the  autocorrelation  function  for  the  background 
additive  noise.  We  will  assume  that  the  z-transform  of  0no(k),  Sno(z),  can  be  expressed  as  a 
rational  function  of  z,  i.e., 


!~ J (z  - e~Fm  + jfl'm)  (z'l  - e"Fm  - j^m) 

. , . 2 ni=l  

^no^z)  ” ano 

o 

n<z  - e^n  + j^n)  (z~l  _ e-n'ti  ~ 
n=l 


(11) 


where,  as  in  the  case  of  Eq.  (3),  the  and  are  non-zero,  positive  real  constants  and 
-;r  < ojJ,,  0'm  < it,  for  all  m,n. 

Also,  in  Eq.  (1 1),  o^G  is  a real  positive  constant  and  it  will  be  assumed  that  M0  < NQ. 

Note  that  for  large  k,  0no(k)  will  consist  of  sums  of  damped  exponentials  with  mag- 
nitudes decaying  as  e-0^*  Therefore,  the  assumption  that  the  decorrelation  interval  for  the 
broadband  noise  is  much  smaller  than  that  for  the  narrowband  processes  is  equivalent  to 
requiring  that 


n = l,  2, ....  N,  (12) 

n 

where  amin  denotes  the  smallest  of  all  the  a},  (n  = 1 , 2, . . . , N0).  It  is  this  property  of 
broadband  noise  and  narrowband  signals  which  may  be  exploited  when  choosing  a value  for 
A as  will  be  discussed  later. 

As  shown  in  the  previous  section,  once  the  zeroes  and  poles  of  Sxx(z)  are  known,  the 
w*  (k)  and  (co)  can  be  determined  through  Eqs.  (4)  through  (6)  and  (8).  Although 
the  poles  of  SXx(z)  are  simply  the  poles  of  Sno(z)  as  well  as  those  obtained  from  the  2N  sig- 
nal poles  (i.e.,  exp  (±an  ±joJn)(n  =1,2,...,  N)),  the  zeroes  of  Sxx(z)  do  not  have  a simple 
analytic  form  (except  for  special  cases  involving  small  values  of  N,  M0,  and  N0).  However, 
when  the  an  are  all  much  smaller  than  unity  so  that  the  background  rtoise  spectral  density 
may  te  closely  approximated  from  Sxx(eJa;)  (oj  *=  o>n)  (i.e.,  no  appreciable  overlap  of 
signal  spectra),  then  a simple  approximating  expression  for  the  zeroes  may  be  derived. 

The  details  of  this  appioximation  are  given  in  Appendix  C.  The  resulting  approxi- 
mate expressions  for  the  zeroes  are  given  by  (Appendix  C,  Eq.  (C-20)): 


rMm  + j0m. 


m = 1, . . . , M, 


s±0n  + j’/'n 


where 


n = 1, . . . , 2N 


Pn  = cosh  * | cosh  a n + — SNRn  sinh  an  j 


0n+N  = 0n  for  n = 1 N 

* n = wn  and  *n+N  = "wn 


n = 1 N. 


In  Eq.  (13),  SNRn  = a^/Sno(e-’a>n)  and  is  the  signal-to-noise  spectral  density  ratio  (SNR)  at 
the  nth  signal.  It  should  be  noted  that  for  small  an,  0n  in  (13b)  may  be  further  approximated 
by: 

0n  = >i“n  + SNRnan-  (14) 
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Equations  ( 1 3a)  through  ( 1 3c)  show  that  as  the  an  approach  zero,  the  zeroes  of 
SXx(z)  can  be  approximated  by  the  M0  zeroes  of  Sno(z)  and  the  zeroes  due  to  the  narrow- 
band  signals.  These  signal  zeroes  are  displaced  slightly  back  along  radial  lines  from  the  signal 
pole  locations.  As  the  signal  bandwidths  approach  zero,  both  the  signal  zeroes  and  poles 
approach  the  unit  circle.  However,  the  signal  poles  approach  the  unit  circle  faster  (as  a func- 
tion of  the  an)  than  the  signal  zeroes,  i.e.,  we  have  from  Eq.  (14)  (or  (13b))  that: 

0n  *VSNRn  an,  (15) 

as 

an^0(SNRn  fixed). 

Also,  from  Eq.  (13),  as  the  signal  powers  approach  zero,  the  signal  zeroes  cover  the  signal 
poles  and  SXx(z)  reduces  to  Sno(z)  as  it  should. 


To  obtain  a better  feeling  for  the  approximations  involved  in  Eq.  (13),  plots  are  pre- 
sented in  Figures  2 through  5 of  Sxxfe^)  (-n  < u>  < it)  computed  exactly  and  computed 
approximately  using  Eq.  (13)  for  two  narrowband  signals  embedded  in  broadband  noise.  In 
the  cases  selected,  the  autocorrelation  function  of  the  signals  is  given  by 

a i cos  2jrfjk  + e-a2lk|  Cos  27rf2k, 

and  the  autocorrelation  function  of  the  noise  is  given  by 

P0«(k)  + P1e-a0lkl. 

2 2 

In  Figures  2 through  5,0)  = o2  = 1.0,  P0  = 5.0,  fj  = 0.125,  f2  = 0.375,  a]  =0.05,  and  a0, 
a2>  ar,d  Pi  are  variable.  As  is  seen  in  these  figures,  Eq.  (13)  provides  a very  good  approxima- 
tion to  the  true  zeroes  of  the  input  power  spectrum.  In  fact,  in  Figures  2 through  4,  the 
exact  and  approximate  curves  lie  on  top  of  each  other.  The  only  noticeable  difference  occurs 
in  Figure  5 in  the  vicinity  of  the  lower  signal  frequency  fj  =0.125  where  the  background 
noise  spectral  density  is  not  flat.  As  noted  in  Appendix  C (C-19),  the  approximations 
expressed  by  Eq.  (13)  become  worse  when  the  spectral  density  of  the  noise  varies  consider- 
ably in  the  vicinity  of  the  signal. 


S)  01 
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— 

....  APPROXIMATE 

. 

Figure  4.  Exact  and  approximate  plots  of  SXx(eJUv  0n  dB)  for  of  = ot 
P0  = Pi  =5.0; ao=  1.0;ai  =0.05;a2  = 0.01; fj  =0.125;  and  f2  = 0.375 


____  EXACT 
APPROXIMATE 


Figure  5.  Exact  and  approximate  ploti  of  SXx(eJW)  0"  dB)  for  of  = o2  = 1 
Pq“  Pi  * 5.0;ao  * 0.50;  cq  * 0.05; a2  = 0.01;  f)  = 0.1 25;  and  f2  = 0.375. 
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THE  LPF  IMPULSE  RESPONSE  AND  TRANSFER  FUNCTION 

Under  the  assumption  of  small  an  so  that  Eq.  (13)  is  valid,  we  can  now  obtain  the 

impulse  response,  w*(k)  (k  = 0,  1 L - 1 ) directly  from  Eq.  (4).  In  order  to  gain  some 

insight  into  the  analytic  structure  of  w*(k),  it  is  useful  to  decompose  the  impulse  response 
as  follows: 

w*(k)  = hs(k)  + hno(k)  k = 0,  1 L-l.  (16) 

In  Eq.  (16)  hs(k)  consists  solely  of  damped  exponentials  at  the  signal  zeroes  and  is  given  by: 

2N  i 

hs(k)=X  jB+se^nk+jwnk  + B^e^n(L- 1 -k)+jconk|(  (17) 

n=l 

where  wn+N  = -<*>n  (n  = 1 , 2,  . . . , N).  0n  is  given  by  Eq.  (13),  and  the  determination  of  the 
B*s  will  be  discussed  presently.  Also  in  Eq.  (16),  hno(k)  is  given  by: 


N0-M0 

+ ^ {c+°6(k-r+ l)  + (£°6(k  + r-L)J.  (18) 

r=l 

In  Eq.  (18),  the  pm  and  e'm  are  defined  by  Eq.  (1 1)  and  the  constants  B^°,  Cjr°,  as  well  as 
the  B*s  in  Eq.  (17)  are  determined  as  in  Eqs.  (5)  and  (6). 

As  can  be  seen  from  Eq.  (17),  hs(k)  is  closely  connected  with  the  signal  part  of  the 
input  spectrum  and  hno(k)  is  associated  with  the  noise  part.  However,  hs  and  hno  are 
coupled  together  through  the  constants,  B*s,  B*,0.  and  Cjr°.  In  order  to  further  understand 
this  coupling,  one  must  analytically  treat  Eqs.  (5)  and  (6).  Such  a treatment,  which  is 
straightforward  (though  tedious),  has  been  carried  out  in  Appendix  D and  some  useful 
approximate  results  are  obtained  for  two  important  limiting  cases  of  practical  interest. 


I 

i 


I 

r 


■j\ 


Description  of  LPF  for  L ■ 

The  first  limiting  case  considered  is  that  of  large  filter  length.  Specifically,  for  this 
case  we  require  that: 


1 


L>  — , 

"m 


for  all  m = 1 , 2, . . . , M0 


(19a) 


and 


1 


L > — , for  all  n = 1 , 2, . . . , 2N. 

0n 


(19b) 


This  particular  case  provides  an  indication  of  the  limiting  resolution  which  can  be  achieved 
by  the  LPF.  As  discussed  in  Appendix  D,  when  Eq.  (19)  is  satisfied  and  when  the  0n  are 


i ' 


..hfr. 
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very  small  (narrowband  signal  case),  the  approach  zero  and  the  equations  for  the 
uncouple  (approximately)  resulting  in  the  following  expressions  for  the  B*s  (Appendix  D, 

1 Eq.  (D-13)): 

Bj**(0n-“n>e-anA+jWnA  n = 1, 2, . . . , 2N,  (20) 

where  in  Eq.  (20),  an+N  = an  and  ^n+N  - -wn  (n  = 1 , 2, . . . , N).  The  approximations 
required  for  the  validity  of  Eq.  (20)  include  Eq.  (19)  plus  the  conditions: 

Vn-OLn<\  n =.l,  2, . . . , N (21a) 

and 

\/a'm  < A < l/an,  for  all  n,m.  (21b) 

Note  that  the  noise  decorrelation  condition  Eq.  (21b)  is  consistent  with  the  broadband  noise 
assumption  expressed  by  Eq.  (12). 

Therefore,  from  Eqs.  (17)  and  (20),  it  is  seen  that  for  large  L,  the  signal  part  of  the 
LPF  impulse  response,  hs(k),  will  consist  of  a sum  of  damped  exponentials  decaying  away 
from  the  beginning  of  the  filter  and  the  amplitudes  of  these  exponentials,  0n  “ an»  are  all 
small.  Additional  insight  into  the  signal  part  of  the  LPF  may  be  obtained  by  examining  the 
frequency  response  of  hg(k),  i.e., 

~ 2N 

H^co)  = e"J“  2 hs<k>  e~)uk  ~ J (w)  (22a) 

k=0  n=l 


where 


. 03n-an)e-“nA+jwnA 
Hsn(co)  = e-Jw-2— - - . 

1 -(1  -0n)eJ(<*>n-w) 


(22b) 


Equation  (22)  reveals  that  the  signal  part  of  the  LPF  transfer  function  for  large  L 
consists  of  sums  of  decoupled  bandpass  filters,  H^(co),  centered  at  the  signal  frequencies.  The 
gain  of  the  nth  filter  at  its  center  frequency  is  given  by 


(23) 


For  small  values  of  an,  the  value  of  this  gain  (from  Eq.  (14)  and  provided  Eq.  (21b)  holds)  is 
given  approximately  by 

|H®  (wn)|  * 1 - (1  + SNRn/anr*.  (24a) 

Note  from  Eq.  (24a)  that  as  SNRn/on  approaches  zero,  |H*(wn)|  approaches  zero  as 


TSNRn/“n- 


(24b) 
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Vice  versa,  as  SNRn/an  becomes  large,  |H*(o;n)|  approaches  unity  as: 


1 -«*n/SNRn)*.  (24c) 

Also,  it  is  seen  from  Eq.  (23)  that  as  an^  becomes  large  (so  that  Eq.  (21b)  is  violated),  the 
signal  as  well  as  the  noise  is  decorrelated  by  the  LPF  and  |H* (oon)|  approaches  zero. 

Another  property  of  the  nth  decoupled  signal  filter  which  is  revealed  by  Eq.  (22b)  is 
that  its  3-dB  half-bandwidth  is  approximately  equal  to  0n  On  angular  frequency).  This  prop- 
erty along  with  Eqs.  (13)  through  (15)  show  that  only  for  small  values  of  SNRn  (SNRn  <an) 
can  the  n*b  signal  filter  bandwidth  reduce  to  the  bandwidth  of  the  n^1  signal  as  L -*■  °°.  For 
larger  values  of  SNRn,  the  passband  of  H*  (oj)  will  become  increasingly  wider  than  the  signal 
bandwidth.  This  widening  effect  has  the  simple  interpretation  that  when  there  is  little  noise 
in  the  vicinity  of  the  signal,  the  LPF  frequency  response  can  afford  to  widen  at  the  signal 
frequency.  This  is  possible  since  there  is  very  little  input  noise  power  near  the  signal  which 
will  pass  through  to  the  LPF  output.  However,  as  the  input  power  in  the  relatively  uncorre- 
lated noise  increases  near  the  signal  frequency,  the  LPF  frequency  response  becomes  nar- 
rower and  smaller  in  magnitude  (24b)  in  the  vicinity  of  the  signal  in  order  to  suppress  the 
increased  uncorrelated  noise  as  it  passes  to  the  LPF  output. 

Note  that  the  bandwidth  and  peak  magnitude  of  the  LPF  output  signal  power  spec- 
trum will  mainly  depend  on  the  input  signal-to-noise  spectral  density  ratio  and  the  input 
signal  bandwidth.  Specifically,  as  the  ratio,  SNR/a,  becomes  small,  the  gain  of  the  LPF  at 
the  center  frequency  of  the  signal  approaches  zero  (from  Eq.  (24b)),  and  the  3-dB  bandwidth 
of  the  LPF  approaches  the  3-dB  bandwidth  of  the  signal  ((13)  - (15)).  Therefore,  in  this 
limit  the  peak  magnitude  of  the  LPF  output  signal  power  spectrum  will  approach  zero  and 
the  6-dB  bandwidth  of  the  output  signal  will  approach  the  3-dB  bandwidth  of  the  input  sig- 
nal, thereby  producing  considerable  distortion  in  the  output  signal  power  spectrum.  How- 
ever, for  large  values  of  SNR/a,  the  gain  of  the  LPF  at  the  center  frequency  of  the  signal 
approaches  unity  (from  Eq.  (24c))  and  the  3-dB  bandwidth  of  the  LPF  becomes  increasingly 
larger  than  that  for  the  signal  ((13)  - (15)).  Therefore,  as  SNR/a  becomes  larger,  the  peak 
magnitude  and  3-dB  bandwidth  of  the  output  signal  power  spectrum  are  approximately  equal 
to  that  for  the  input  signal  power  spectrum,  thereby  producing  little  signal  distortion. 

Another  term  which  remains  to  be  discussed  is  that  part  of  the  LPF  which  is  associated 
with  the  noise,  i.e.,  hno(k)  which  is  given  by  Eq.  (18).  As  discussed  in  Appendix  D,  when 
Eq.  (19)  is  satisfied,  the  C“°  and  BJ$  in  Eq.  (18)  approach  zero  and  hno(k)  will  only  consist 
of  damped  exponentials  and  delta  functions  which  occur  at  the  beginning  of  the  filter.  Also, 
as  discussed  in  Appendix  D,  when  Eq.  (21 ) is  satisfied  the  B^  and  Cf®  in  Eq.  (18)  can  be 
expressed  as  linear  combinations  of  the  B^  which  are  given  approximately  by  Eq.  (20). 

Further  insight  into  the  noise  part  of  the  LPF  may  be  obtained  by  examining  the  fre- 
quency response  of  hno(k),  i.e., 

OO 

H&«)  = e**>  J hno<k>e“jwk 

k=0 

M0  N0-M0 

- ^ Hj,(w)+  £ G?(cu)  (25a) 

m=l  r=l 


where 


-jWB 


+0 

m 


1 _ e~^m  + j(^m  ~ <*>) 


(25b) 


and 

G^co)  = C+°  e-W. 

Note  that  the  peak  magnitude  value  of  the  H®(a>)  is  given  by 


"O 

1 - e"^m  ’ 


(25c) 


(26) 


(27) 


The  relations  expressed  by  Eqs.  (25)  through  (27)  reveal  that  in  general  the  noise  pari  of  the 
LPF  frequency  response  can  contribute  non-negligible  peaks  to  the  total  LPF  transfer  func- 
tion, especially  if  some  of  the  #im  are  close  to  zero  (as  can  be  seen  from  Eq.  (26)).  However, 
since  the  B^P  and  are  linearly  related  to  the  B*s  as  discussed  previously,  the  magni- 
tudes and  C+®  will  become  increasingly  small  as  the  differences,  0n  - an,  all  approach 
zero  as  can  be  seen  from  Eq.  (20).  Therefore,  provided  the  noise  spectrum  does  not  contain 
deep  nulls  (i.e.,  small  /im)  and  provided  that  the  f)n  - an  are  all  very  small  (e.g.,  narrowband 
signal  case),  then  the  noise  part  of  the  LPF  frequency  response  will  be  very  small. 


For  purposes  of  numerically  examining  the  approximate  expressions  derived  in  this 
section,  plots  are  presented  in  Figures  6-8  of  |Hl(oj)|2  computed  exactly  using  Eq.  (1)  and 
computed  approximately  using  Eq.  (22)  for  three  representative  cases.  (Note  that  the 
approximate  expression  given  by  Eq.  (22)  does  not  include  the  noise  contributions  to  the 
LPF  transfer  function.)  In  these  figures,  the  forms  of  the  input  signal  and  noise  autocorrela- 
tion functions  are  equivalent  to  that  used  in  Figures  2-5.  Figures  6 and  7 correspond  to  the 
case  of  uncorrelated  input  noise.  As  is  seen  in  these  two  figures,  there  is  excellent  agreement 
between  the  exact  curve  and  the  approximate  curve  (computed  from  Eq.  (22)).  Figure  8 
corresponds  to  the  case  when  the  power  spectral  density  of  the  input  noise  varies  as  a function 
of  the  frequency.  Note  that  in  this  figure,  there  is  excellent  agreement  in  the  vicinity  of  the 
signal  peaks.  However,  there  are  discrepancies  between  the  exact  and  approximate  curves 
especially  at  f = 0.  These  discrepancies  are  mainly  due  to  the  contributions  from  the  noise 
part  of  the  LPF  which  are  not  included  in  the  computation  of  the  approximate  curve.  The 
close  agreement  between  the  exact  and  approximate  curves  is  indicative  of  the  fact  that  the 
noise  contributions  to  the  LPF  transfer  function  are  negligible  when  Eq.  (21b)  is  satisfied. 


It  is  interesting  to  compare  Figures  6 and  8 with  Figures  3 and  5,  especially  at  the  sig- 
nal frequency  f2  * 0.375.  The  increased  3-dB  bandwidth  of  the  LPF  over  the  input  signal 
3-dB  bandwidth  is  clearly  seen. 


$ 


Figure  8.  Exact  and  approximate  plots  of  |Hl(w)|2  (in  dB)  for  = »2  = I .0;  Po  = Pj  = 5.0; 
ao  = 0.5;ai  = a2  = 0.01;fi  = 0.125;  f2  = 0.375;  L = 256;  and  A = 10. 


Description  of  LPF  as  the  Input  Signal  Bandwidths  Approach  Zero 

It  must  be  emphasized  that  the  results  just  discussed  are  only  valid  when  L is  large 
enough  so  that  Eq.  (19)  is  satisfied.  Clearly,  in  many  cases  of  practical  interest,  Eq.  (19)  will 
not  be  satisfied.  In  particular  as  the  signal  bandwidths  approach  zero,  the  0n  will  also 
approach  zero  and  (19b)  will  eventually  be  violated  for  L fixed.  It  is  this  limiting  case  which 
will  be  examined  in  this  subsection.  Specifically,  it  will  be  assumed  that  the  an  are  small 
enough  so  that; 


-C 

I 
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L < l/0n,  for  all  n=  1 2N.  (28) 

Note  that  in  this  limit,  the  signal  part  of  the  autocorrelation  function  becomes  purely 
sinusoidal  for  k = 0,  1, . . . , L - 1 in  Eq.  (10).  Therefore,  the  treatment  in  this  section  will 
provide  a description  of  the  LPF  for  the  special  case  when  the  input  consists  of  sinusoids 
embedded  in  additive  broadband  noise. 


As  can  be  seen  from  Eq.  (D-19)  in  Appendix  D,  the  signal  part  of  the  LPF,  hs(k), 
becomes  approximately  sinusoidal  when  Eq.  (28)  is  satisfied,  i.e., 


2N 


hs(k)  * £ An  e^nk  , 
n=l 


for  an  ^ 0. 


(?9) 
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As  discussed  in  Appendix  D,  when  L is  large  enough  for  the  LPF  to  resolve  the  sinusoids  but 
yet  small  enough  so  that  Eq.  (28)  is  satisfied,  then  the  An  are  given  approximately  by 
(Appendix  D,  Eq.  (D-20)): 

SNRn/2  . 

A * 2 eJ^nA  (30) 

An  l + LSNRn/2 

The  validity  of  Eq.  (30)  also  requires  that  the  background  noise  be  decorrelated  by  the  LPF, 
i.e.,  Eq.  (21b)  must  be  satisfied. 

Equations  (29)  through  (30)  imply  that  the  frequency  response  of  the  signal  part  of 
the  LPF,  Hj^(co)  can  be  approximated  by  a superposition  of  uncoupled  bandpass  filters,  i.e., 

2N 

Hl(w)  * £ T*(m),  (31a) 

n=l 

where 

/e-i“(SNR„/2)  e^nAy  , _ ej(q,n  - „)L  \ 

Tn(w)-\  1 + LSNRn/2  ) \ j . ej(wn  - <*>)  / ' ) 

The  gain  of  the  n1*1  filter  at  its  center  frequency  is  given  by: 

LSNRJ2 

|Tn(wn)l  = 1 + LSNRn/2  ' (32) 

The  results  expressed  by  Eqs.  (29)  through  (32)  are  straightforward  extensions  of  the  results 
presented  in  References  [12]  and  [22]  for  the  uncorrelated  background  noise  case.  A fur- 
ther discussion  can  be  found  in  these  references. 

The  noise  part  of  the  LPF,  hno(k)  in  Eq.  (18),  may  be  treated  in  analogy  with  the 
treatment  already  presented  (i.e.,  Eqs.  (25)  through  (27)).  Specifically  provided  Eq.  (21b) 

is  satisfied,  the  B^°  and  C*°  in  Eq.  (18)  will  be  linearly  related  to  the  An  as  discussed  in 

Appendix  D.  Further,  when  the  magnitude  of  the  An  are  small  and  provided  there  are  no 
deep  nulls  in  the  input  noise  spectrum  (as  discussed  in  the  previous  subsection),  then  the 
effects  of  the  noise  part  of  the  LPF  will  be  small. 

Plots  of  |Hl(w)I^  which  compare  the  exact  solution  for  |Hl(oj)I^  obtained  from 
Eq.  ( 1 ) as  well  as  the  approximations  provided  by  Eq.  (3 1 ) are  presented  in  Figures  9—1 0 for 
two  representative  cases.  In  these  two  figures,  the  forms  of  the  signal  and  noise  autocorrela- 
tion functions  are  equivalent  to  that  used  in  Figures  2-8.  In  Figure  9,  the  input  noise  is  cor- 
related. As  in  the  case  of  Figure  8,  there  is  good  agreement  between  the  exact  and  approxi- 
mate curves  near  the  signal  peaks,  but  some  discrepancies  near  f = 0.  These  discrepancies  are 
mainly  the  result  of  ignoring  the  noise  part  of  the  LPF  in  computing  the  approximate  curve. 
In  Figure  10,  the  input  noise  is  uncorrelated  and  the  signal  bandwidths  are  chosen  such  that 
Eqs.  (31)  and  (22)  provide  good  approximations  to  the  LPF  response  to  the  signals  at 
f * 0.1 25  and  f ■ 0.375,  respectively.  Therefore,  the  LPF  can  be  approximated  as  a sum  of 
two  bandpass  filters  centered  at  f * 0.125  and  f = 0.375,  with  Eqs.  (31)  and  (22)  providing 
good  approximations  to  the  bandpass  filters  located  at  f * 0. 1 25  and  f = 0.375,  respectively. 
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As  is  seen  in  Figure  10,  this  approximation  provides  good  agreement  with  the  exact  curve. 
Note  that  the  behavior  of  the  LPF  in  the  vicinity  of  f = 0.125  is  oscillatory  in  contrast  to  its 
behavior  at  f = 0.375.  This  is  a consequence  of  the  fact  that  the  LPF  has  completely  resolved 
(0L  > 1 )» the  signal  at  f = 0.375. 

The  approximate  expressions  given  by  Eq.  (22)  for  large  values  of  L0n  and  those  given 
by  Eq.  (3 1 ) for  small  values  of  L0n  will  provide  a good  description  of  an  LPF  for  a rather 
broad  class  of  inputs  which  consist  of  narrowband  processes  and  additive  noise.  Specifically, 
for  an  input  consisting  of  N narrowband  signals  in  noise,  the  LPF  will  form  bandpass  filters 
at  the  signal  frequencies  (provided  the  components  of  hs(k)  in  Eq.  (17)  decouple).  The  ana- 
lytical structure  of  the  nth  bandpass  filter  will  then  be  described  either  by  Eq.  (22)  or  Eq. 
(31)  depending  on  whether  L0n  > 1 or  L0n  < 1 , respectively  (as  in  Figure  10).  When 
L0n  **  1 , then  hs(k)  will  consist  of  damped  exponentials  decaying  away  from  both  ends  of 
the  filter  (see  Eq.  (17)).  Assuming  the  components  of  hs(k)  decouple,  then  an  approximate 
expression  for  the  nth  bandpass  filter  when  L0n  * 1 may  be  obtained  by  solving  the  two 
simultaneous  equations  for  B*s  and  which  are  provided  by  Eqs.  (5)  and  (6)  (with  all  the 
Cjr  = 0 and  N = M = 1 in  Eqs.  (5)  and  (6)). 


A DERIVATION  OF  THE  LPF  FOR  AN  ALL-POLE  NOISE  SPECTRUM 

In  the  last  subsection,  properties  of  the  LPF  were  discussed  for  inputs  consisting  of 
signals  and  noise.  In  this  section,  we  will  examine  the  special  case  when  all  of  the  signal 
powers  vanish  and  when  the  noise  spectrum  contains  only  poles.  This  particular  case  is  of 
interest  as  it  provides  additional  insight  into  the  basic  structure  of  the  LPF.  For  this  special 
case,  SXx(z)  has  the  form: 


Sxx<z>  = 7 ■ (3‘ 

PJ(z-zn)  (z-1  -zn) 
n=l 

where  is  a real  positive  constant  and  all  the  zn  in  Eq.  (33)  are  assumed  to  lie  inside  the 
unit  circle. 

The  spectral  representation  in  Eq.  (33)  is  equivalent  to  the  time  series  model  repre- 
sentation for  x(j)  [17): 


akx(j-k-l)  + u(j), 


where  u(j)  is  an  uncorrelated  sequence  with  power  equal  to  o^.  A process  which  can  be 
represented  as  in  Eq.  (34)  is  termed  an  autoregressive  (AR)  process  of  order  p.  From  Eq. 
(33)  it  is  seen  that  a FIR  filter  of  order  p can  produce  an  output  with  a completely  fiat  spec- 
trum when  the  input  to  the  filter  is  an  AR  or  all-pole  process.  In  fact,  from  Eq.  (34),  it  is 
seen  that  the  required  coefficients  for  a FIR  “whitening”  filter  are  given  by: 


(I,  -a0’  -*!»•••• ““p-l  )• 


This  fact,  together  with  the  “whitening”  filter  interpretation  of  the  LPF  discussed  in  Section 
II  reveals  that  provided  A = 1 in  Figure  1,  the  LPF  coefficients,  w (k),  of  an  L-point  predic- 
tion filter  (L  > p)  will  be  given  by 


w*(k)  = 


ak,  k = 0,  1, . . . , p - 1 
0,  k = p, . . . , L 


(36) 


The  connection  between  the  an  in  Eq.  (34)  and  the  coefficients  of  a p-point  LPF  can 
be  derived  alternatively  by  multiplying  both  sides  of  Eq.  (34)  by  x(j  - C - 1 ) and  taking  expec- 
tations. The  resulting  equations  for  £ = 0,  1 , . . . , p - 1 are  given  by 


P-1 

^ ak  ^xx*2  - k>  = + 8 = 0,  1 P - 1,  (37) 

k=0 

which  are  identical  to  Eq.  (1)  for  the  LPF  coefficients,  w*(k),  with  L = p.  Another  property 
of  the  aj(  which  relates  them  to  the  zn  in  Eq.  (33),  is  given  by  Eqs.  (5)  and  (6)  (with  A = 1 ; 

N = p;  Ck  = ak_! ; zn  = e-0^  +S^n- and  B^,  C"  = 0),  i.e., 


P-1 

^ ak  z“k  = zn  n = 1, . . . , p.  (38) 

k=0 

It  should  be  noted  that  Eq.  (38)  is  equivalent  to  the  relationship  between  the  afc  and  zn  which 
is  derived  by  equating  powers  of  z_n  between  the  polynomial 

fcj 

1 - \ ak  z-k“* , (39a) 

k=0 

and  the  expansion 
P 

J~[(l  - z-1  zn).  (39b) 

n=l 

The  p X p coefficient  matrix  of  the  ak  in  Eq.  (38)  is  a Vandermonde  matrix  and 
many  of  its  properties  were  derived  in  Reference  [25]  for  purposes  of  treating  the  continuous 
analog  of  Eq.  (1).  (See  also  References  [26]  and  [27] .)  In  the  general  case  when  A > 1 and 
SXx(z)  >s  given  by  Eq.  (33),  there  will  still  be  only  p non-zero  LPF  coefficients  for  an  L-point 
prediction  filter  (L  > p),  however,  these  coefficients  will  satisfy  (from  Eqs.  (5)  and  (6)): 

P-1 

2 w*<k>  *nk  = zn  n = 1 , 2 p.  (40) 

k=0 

An  alternative  treatment  of  the  all-pole  noise  case  for  A > 1 is  given  in  Reference  [ 28] , 
Chapter  7. 
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IV.  HARDWARE  SIMULATIONS  OF  AN  ADAPTIVE 
IMPLEMENTATION  OF  AN  LPF 

As  discussed  in  Section  I,  there  are  many  adaptive  implementations  of  Wiener  filters 
which  continuously  estimate  the  Wiener  filter  coefficients.  In  this  section,  we  will  examine 
the  steady  state  response  of  an  LMS  adaptive  filter  (3-51  to  three  types  of  stationary  •’puts- 
one-pole  low  pass  noise,  a narrowband  signal  plus  one-pole  low  pass  noise,  and  a sinusoid  in 
bandlimited  noise.  As  will  be  seen,  the  analysis  presented  in  Sections  II  and  III  will  provide 
a good  description  of  the  experimental  results  presented  in  this  section. 

The  specific  configuration  of  the  LMS  adaptive  filter  considered  in  this  section  is 
known  as  the  Adaptive  Line  Enhancer  (ALE).  The  LMS  algorithm  for  the  ALE  is  as  follows: 

wj+1(k)  = Wj(k)  + 2px(j  - A - k)  e(j)  (41a) 

and. 


L-l 

e(j)  = x(j)  - ^ xG  - A - n)  Wj(n),  k = 0,  1 , . . . , L - 1 . (41b) 

n=0 

In  Eq.  (4 1 ),  wj(k)  represents  the  k1*1  ALE  filter  coefficient  at  iteration  j;  p is  a scaiar  repre- 
senting the  influence  of  the  input  x(j)  on  the  (j  + 1)  update  of  w(k);  and  L and  A are,  respec- 
tively, the  number  of  weights  and  the  delay. 

A summary  of  many  of  the  properties  of  the  ALE  can  be  found  in  References  (121, 
[21 1 , [29) , and  [35] . As  discussed  in  these  references,  provided  /i  is  small  enough  and  pro- 
vided the  input  data  is  statistically  stationary,  then  the  mean  of  the  ALE  filter  weights  will 
converge  within  a good  approximation  to  the  LPF  coefficients  described  by  Eq.  (1).  Since 
the  effective  integration  time  of  the  ALE  is  finite,  the  steady-state  ALE  filter  coefficients 
will  contain  a random  fluctuating  component.  However,  the  variance  of  this  component  can 
be  kept  arbitrarily  small  by  reducing  p </>Xx( 0)  (at  the  expense  of  increasing  the  ALE  con- 
vergence time).  In  the  experiments  described  in  this  section,  p was  kept  small  enough  that 
weight  vector  noise  was  negligible  and,  therefore,  Eq.  (1)  and  the  results  presented  in  Sec- 
tions II  and  III  provided  a good  description  of  the  steady  state  response  of  the  ALE 

The  experimental  data  presented  in  this  section  were  obtained  on  a variable  length 
hardware  implementation  of  the  ALE  which  was  designed  and  built  at  the  Naval  Ocean  Sys- 
tems Center.  Filter  lengths  of  8,  16,  32,  64,  128,  and  256  weights  can  be  obtained  with  this 
hardware.  Experimental  plots  of  the  steady  state  ALE  weights  were  obtained  by  “freezing” 
the  weights  at  a particular  instant  (after  convergence).  Experimental  plots  of  the  steady  state 
frequency  response  of  the  ALE  were  obtained  by  first  “freezing”  the  weights  (after  conver- 
gence) and  then  applying  white  noise  to  the  input  of  the  stationary  filter  and  spectral- 
analyzing  the  resulting  output.  The  first  case  examined  was  when  the  ALE  input  consisted 
of  stationary'  noise  which  was  generated  by  passing  white  noise  through  a one-pole,  low  pass 
filter.  For  this  case,  the  LPF  impulse  response  consists  of  only  one  weight  at  the  beginning 
of  the  filter  as  discussed  in  the  third  subsection  of  Section  III,  i.e., 

w*(k)  = e~“A5(k).  (42) 

This  was  indeed  observed  as  indicated  in  the  experimental  plots  presented  in  Figure  1 1 for 
three  different  values  of  ALE  delay,  A.  In  this  figure,  the  vertical  scale  is  not  absolute, 
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Figure  11.  Plot  of  the  ALE  weights,  w(k),  vs  k (after  convergence)  for  three  different  values  of  delay. 

The  input  autocorrelation  function,  0xxO<)>  was  given  by  Poe"°Olk|  where  aofs/2rr  = 250  Hz  and 
L = 256.  The  sample  frequency,  fs,  was  3500  Hz.  (Po  was  held  constant  in  all  three  experiments.) 

however,  the  magnitude  of  the  first  weight  decreases  as  exp  (- aA ) with  increasing  A as  would 
be  expected  from  Eq.  (42).  In  fact,  the  ratio  of  the  measured  values  of  the  first  weight  in 
Figure  11  is  given  approximately  by:  17.5:11.0:7.0*2.5:1.6:1.  This  compares  quite  favor- 
ably with  the  theoretical  expression  for  this  ratio  (Eq.  (42)),  i.e., 

e2aA.eaA;1  (43) 

Using  the  measured  value  for  a from  Figure  ! 1 , it  is  seen  that  Eq.  (43)  predicts  the  ratio  of 
the  first  weights  to  be: 

e4ir-250/3500:e2ir250/3500:1  2.5: 1.6:1, 

which  agrees  with  the  experimental  results. 
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The  second  experimental  case  examined  corresponds  to  an  input  consisting  of  a nar- 
rowband signal  embedded  in  additive  one-pole  low  pass  noise.  The  signal  was  generated  by 
filtering  uncorrelated  noise  with  a two-pole  bandpass  filter.  The  bandwidth  of  the  signal  was 
small  enough  that  the  sinusoidal  approximation  is  valid.  This  case  illustrates  the  noise  decor- 
relation property  of  a variable  delay  (prediction  distance)  LPF.  The  expression  for  the  LPF 
impulse  response  may  be  obtained  in  Appendix  D from  Eqs.  (D-l),  (D-3),  (D-16)  through 
(D-18),  and  (D-l  9)  (with  N = 1 , No  = 1 , and  Mo  = 0): 

w*(k)  = A,ejwlk  +A2e~jwlk  + c|°  6(k  -r  + 1)  + C[°  6(k  + r - L).  (44) 


;*\v » 
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As  can  be  seen  from  Eq.  (44),  the  LPF  impulse  response  consists  of  a sinusoid  at  the  signal 
frequency  as  well  as  two  delta  functions  which  occur  at  the  beginning  and  end  of  the  filter. 
The  constants  Aj,  A2,  and  C in  Eq.  (44)  can  be  obtained  from  Eqs.  (D-16)  throi^h  (D-18). 
The  result  is: 


A,  - A2  = 


,jtoiA_e-aA 


L + 2/SNR  + (cos  a)  j - e_a)/(cosh  a - cos  to  j ) 


+0  -aA 
1 6 


2 
n ~ 1 


A 


n 


1 -e-^+J^n 


AnejwnL 

1 _ e-«  + jwn 


and 


(45a) 


(45b) 


(45c) 


■y  cosh  a - COS  GJ  1 

SNR  = (of/Pn) , (45d) 

1 sinh  a 

2 

where  in  Eq.  (45)  102  = -toi , and  0 j and  Po  represent  the  signal  power  and  noise  power, 
respectively.  Equation  (45a)  is  only  an  approximation  for  Aj.  In  deriving  this  approxima- 
tion, we  have  neglected  all  coupling  between  Ai  and  A2  which  occurs  in  Eqs.  (D-16)  through 
(D-18).  This  approximation  is  very  good  in  the  experimental  case  we  are  presently  consider- 
ing. Note  that  as  aA  -*  <»,  and  further  as  L * 00  and/or  SNR  -*■  0,  Eq.  (45a)  reduces  to  Eq. 
(30),  as  expected.  Note  also  that  in  the  limit  of  large  L and/or  small  SNR,  Aj  becomes  very 
small  and  provided  aA  < 1 , then  C|®  is  given  approximately  by: 

Cj° * e~“A.  (46) 

The  characteristics  of  the  LPF  expressed  by  Eq.  (45)  were  observed  as  indicated  in 
the  experimental  plots  presented  in  Figure  1 2 for  two  different  values  of  ALE  delay,  A.  As 
in  the  case  of  Figure  1 1 , the  vertical  scale  in  Figure  1 2 is  not  absolute.  Also,  the  sinusoids  in 
Figure  12  were  plotted  with  the  frequency,  phases,  and  amplitudes  of  these  sinusoids  being 
estimated  from  the  display  of  the  weights  on  an  oscilloscope.  As  can  be  seen,  the  magnitude 
of  the  large  impulse  at  the  beginning  of  the  filter  decreases  as  the  delay  is  increased.  In  fact, 
the  ratio  of  the  measured  values  of  the  first  weight  in  Figure  1 2 is  given  approximately  by: 
20.0:6.0  = 3.3:1.  Assuming  the  first  weight  to  be  given  approximately  by  Eq.  (46)  gives  the 
following  predicted  value  for  this  ratio: 

e6jr*  250/3500.  j = 3 q.  j 

This  value  is  somewhat  higher  than  the  measured  value.  This  discrepancy  is  due,  in  part,  to 
the  fact  that  we  are  approximating  the  first  weight  by  Eq.  (46).  Another  characteristic  of  the 
LPF  which  can  be  observed  in  Figure  1 2 is  the  increase  in  the  amplitude  of  the  sinusoid  in  the 
ALE  weights  as  the  delay  is  increased.  The  ratio  of  the  measured  values  of  this  amplitude  in 
Figure  1 2 is  given  by:  0.5:1.  The  predicted  value  for  this  ratio  (calculated  from  Eq.  (45a) 
with  A = 1 and  A = 4)  is  also  given  by  0.5: 1 . 


25 


'A  - 1 SAMPLE 


“A- 4 SAMPLES 


A- 1 SAMPLE 

— — — A- 4 SAMPLES 


Figure  12.  Plot  of  the  ALE  weights,  w(k),  vs  k (after  covergence)  for  two  different  values  of  delay. 
The  input  autocorrelation  function,  0xx(k), was given  by  Poe-0^!  + <J|  e-®1  ^1  cos  w jk  where 
aof$/2n  = 250  Hz;  a\fsl2ir  = 0.5  Hz;  w jfs/27r  = 250  Hz;  and  L = 64.  The  sample  frequency,  fs,  was 
3500  Hz.  (Pq/«i  was  held  constant  in  both  experiments.) 


FREQUENCY, Hz 


Figure  13.  Plots  of  the  steady  state  ALE  frequency  response  corresponding  to  four  different  values  of  delay 
for  an  input  consisting  of  a sinusoid  embedded  in  additive  bandlimited  noise.  The  3-dB  bandwidth  of  the 
noise  was  60  Hz  and  the  sample  frequency  was  900  Hz.  Also,  L = 256  and  n 0XX(O) » 1.2  X 1 0-6. 
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The  noise  decorrelation  property  of  the  LPF  for  this  experimental  case  becomes 
apparent  by  noting  that  the  large  impulse  at  the  beginning  of  the  filter  gives  rise  to  an  all  pass 
component  in  the  filter’s  frequency  response.  For  small  values  of  A,  the  LPF  will  pass  a con- 
siderable amount  of  noise  due  to  this  all  pass  component.  However,  as  A is  increased,  the 
LPF  will  suppress  more  noise  as  the  magnitude  of  the  all  pass  component  decreases.  Another 
example  which  illustrates  the  noise  suppression  capabilities  that  can  be  achieved  by  varying 
the  prediction  distance  of  the  LPF  is  presented  in  Figure  13.  In  this  figure,  the  steady  state 
frequency  response  of  the  ALE  is  plotted  for  four  different  values  of  delay  when  the  input 
consists  of  a sinusoid  embedded  in  additive  bandlimited  noise.  The  noise  was  generated  by 
filtering  white  noise  through  an  eight-pole  Butterworth  low-pass  filter  followed  by  an  eight- 
pole  Butterworth  high  pass  filter.  For  purposes  of  comparison,  the  input  spectrum  is  also 
plotted  in  Figure  13.  As  indicated  in  Figure  13,  the  bandlimited  noise  is  suppressed  as  A is 
increased  but  the  sinusoid  is  not  attenuated  for  any  value  of  A selected.  A similar  example 
was  examined  in  Reference  [39] . Additional  experiments  which  compare  the  steady  state 
LMS  filter  response  with  a theoretical  Wiener  filter  may  be  found  in  References  [12],  [ 29 ) , 
and  [36] . 


V.  CONCLUSIONS 

In  this  report  the  Impulse  Response  (IR)  and  Frequency  Response  (FR)  of  a discrete 
LPF  were  examined  for  stationary  inputs  consisting  of  narrowband  signals  embedded  in 
broadband  additive  noise.  In  Section  11  the  general  analytic  form  of  the  IR  and  FR  were 
derived  for  the  general  case  when  the  z-transform,  SXx(z).  of the  autocorrelation  function  of 
the  input  was  a rational  function  of  z.  It  was  shown  that  the  IR  consists  of  sums  of  damped 
exponentials  and  impulses  which  occur  at  both  ends  of  the  LPF.  Further,  the  amplitudes  of 
the  exponentials  and  impulses  which  occur  at  the  end  of  the  LPF  (reflection  amplitudes) 
approach  zero  as  the  length  of  the  LPF  becomes  large. 

In  Section  III,  inputs  consisting  of  narrowband  signals  and  additive  noise,  were  exam- 
ined in  detail.  Specifically,  in  the  first  major  subsection  of  Section  III,  rational  spectrum 
models  were  developed  to  approximate  the  true  input  power  spectrum  of  the  signals  and 
noise.  In  the  next  area  of  Section  III,  the  results  of  Section  II  were  used  to  examine  the  IR 
and  FR  of  the  LPF  for  two  limiting  cases.  First,  when  the  length  of  the  LPF  becomes  very 
large,  it  was  shown  that  its  FR  can  be  approximated  by  a superposition  of  decoupled  band- 
pass filters  located  at  the  signal  frequencies.  The  gain  of  these  filters  at  their  center  frequen- 
cies were  shown  to  approach  unity  as  the  product  of  the  input  signal-to-noise  spectral  density 
ratio  and  the  inverse  signal  3-dB  half  bandwidth,  i.e.,  SNR/a,  becomes  large.  Also,  the  band- 
widths  of  these  decoupled  filters  were  shown  to  become  increasingly  wider  than  the  signal 
bandwidths  as  the  ratios,  SNR/a,  become  large.  Therefore,  only  for  large  values  of  SNR/a 
can  the  LPF  filter  the  input  noise  without  distorting  the  signal  in  the  limit  of  large  filter 
lengths. 

A second  limiting  case  was  considered  when  all  of  the  signal  bandwidths  approach 
zero  (sinusoidal  limit).  In  this  limit,  it  was  shown  that  the  LPF  also  forms  a superposition  of 
bandpass  filters  located  at  the  signal  frequencies.  As  the  product,  L SNR/2,  becomes  large  it 
was  shown  that  the  gain  of  these  filters  approaches  unity.  Therefore,  only  for  large  values  of 
L SNR/2  can  the  LPF  filter  the  input  noise  without  distorting  the  peak  magnitude  of  the  out- 
put signal  power  spectrum  in  the  sinusoidal  limit.  The  special  case  when  the  LPF  input  con- 
sists solely  of  all-pole  noise  was  treated  next  a *ly,  in  Section  IV,  results  of  an 


experimental  simulation  of  an  adaptive  implementation  of  an  LPF  were  presented  and  dis- 
cussed. It  was  shown  that  appropriate  selection  of  the  prediction  distance  A can  provide  an 
enhancement  of  the  narrowband  signal  components  by  suppressing  the  additive  broadband 
noise  contributions  to  the  LPF  impulse  response. 
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APPENDIX  A.  GENERAL  FORM  OF  THE  DISCRETE  LPF  FOR  STATIONARY 
INPUTS  WITH  RATIONAL  POWER  SPECTRUM  REPRESENTATIONS 

The  purpose  of  this  appendix  is  to  develop  a general  form  for  the  solution,  w*(k) 

(k  = 0, . . . , L-l ),  to  the  discrete  analog  of  the  Wiener-Hopf  equation: 

L-l 

-w*(k)0xx(C-k)  = 0XX  (C+A)  , 8-0,. ...L-l,  (A-l) 

k =0 

when  the  z-transform  of  0xx(k),  Sxx(z),  *s  a rational  function  of  z.  The  specific  form  of 
Sxx(z)  considered  here  is 

fl  ( z ~ e_^m  + m)  ( z-* 

Sxx(z)  - , (A-2) 

(z-e^+i0J")  (z-'-e^"-1"") 
n=l 

where  the  and  an  are  non-zero,  positive  real  constants  and 
-7T  < con,  dm<7r , for  all  m,n, 

and  A is  a real,  positive  constant. 

The  treatment  of  Eq.  (A-l ) presented  in  this  appendix  represents  a brief  summary  of 
the  rigorous  treatments  given  in  References  [ 14]  and  [ 16]  for  the  discrete  problem  and  is 
analogous  to  the  treatments  given  in  References  [ 19] , [25] , and  [3 1 ] for  the  continuous 
problem.  Alternative  treatments  of  Eq.  (A-l ) or  its  continuous  analog  include  the  interest- 
ing development  given  in  Reference  [30]  (Appendix  E).  To  develop  a simple  expression  for 
w*  (k),  we  first  note  that  if  the  power  spectrum  of  x can  be  represented  by  Eq.  (A-2)  with 
z = exp  (jcu),  then  xQ)  must  obey  a difference  equation  given  by: 

D(z~*)x(j)  = P(z_,)u(j)  . (A-3) 

In  Eq.  (A-3),  D(z-*)  and  P(z“* ) denote  linear  difference  operators  and  u(j)  represents  a 
stationary,  unconrelated  sequence  with  power  given  by  A in  Eq.  (A-2),  i.e., 

E[u(j)  u(j+m)]  = A6(m)  . (A-4) 

The  specific  forms  of  D and  P are  given  by: 

D(z~b  - J- J (1  -e~°In  jWnz-') 
n=l 

N 

* anz~°  (A-5a) 

n*0 
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and. 


M 

POT1)  = ] | 
m=l 

M 

-s 

m=0 

where  in  Eq.  (A-5)  a0  = bG  = 1 . The  operation  of  D(z-* ) on  x(j)  in  Eq.  (A-3)  results  in  a 


summation  of  the  present  and  weighted  past-values  of  x(j),  i.e., 

N 

D(z_,)x(j)  = ^ anxO-n)  . (A-6a) 

n=0 

Similarly,  we  have  for  P(z~* ) u(j): 

M 

P(z-1)u<j)  = y bmu(j-m)  . (A-6b) 

m=0 

We  now  observe  that  0xx(8-k)  satisfies  Reference,  [ 16]  (chapter  6): 

*xx(8-k)  = APe(z-l)iyT)G(8-k)  , (A-7a) 

where  G(8  - k)  (which  is  a Green’s  function  [16,25])  is  obtained  from: 

DgTz)  Dg(z~l)  G(8-k)  = 6(8-k)  . (A-7b) 

The  conjugate  linear  operator  P(z)  is  defined  by 
M 

P(z)0(j)  = y bm0G+m).  (A-8) 

m=0 


A similar  definition  holds  for  D(z).  The  “8”  subscripts  on  the  operators  in  Eq.  (A-7)  denote 
that  they  only  operate  with  respect  to  the  8 variable-in  Eq.  (A-7).  Equation  (A-7)  may  be 
verified  by  taking  its  z-transform  (with  k=0)  and  comparing  with  Eq.  (A-2). 

Substituting  Eq.  (A-7a)  into  Eq.  (A-l)  results  in: 

L-l 

w*(k)Pg(z"*)Pg(z)G(e -k)  = A-1  0XX(8  + A)  8 = 0 L-l  , 

k=0 

or,  by  the  linearity  of  the  operators: 

Pg(z“')  Pj(zj  F*(8)  = A“*  0XX(8  + A)  8 = 0 L-l,  (A-9) 


(l-e  Mm+Jtfmz-1 
bm  z_m  , (A-5b) 
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where 


L»"I 

F*(C)  s ^ w*(k)  G(8-k) 


(A- 10) 


Note  that  Eq.  (A-9)  is  in  the  form  of  an  ordinary  difference  equation  with  constant  coeffi- 
cients. Therefore,  a general  solution  of  Eq.  (A-9)  is  given  by  Reference  [ 16) : 


F*(2)  = Fh(C)  + Fp(2),  0 < 8 < L-l  . ( 

In  Eq.  (A- 1 1),  F^  (2)  represents  the  general  solution  of  the  homogeneous  equation 

Pg(z_1)  Pjj(z}  Fh(8)  = 0 , ( 

and  Fp(8)  represents  the  particular  solution  of  Eq.  (A-9).  The  general  solution  of  Eq. 
(A-12),  Fj1(2),  can  be  expressed  as  a linear  superposition  of  damped  exponentials,  i.e., 

F„(t)  - V |d+  A!'*'''"*  I . ( 

m=l  1 


(A-l  1) 


(A-12) 


(A-l  3) 


Note  that  the  exponentials,  zm  = exp(±  /im  + j0m),  are  the  roots  of  the  polynomial 
Pg(z~l)  Pg(z).  The  particular  solution  of  Eq.  (A-9),  Fp(2),  can  be  obtained  by  applying  to 
both  sides  the  difference  operator,  (Pg(z~l)  Pg(z))“l , which  is  inverse  to  the  difference 
operator,  Pg(z“l ) Pg(z).  The  result  for  Fp(8)  is  given  by  Reference  1 16) : 

Fp(2)  = A"1  (Pgfz-1)^))'1  0xx(fi  + A)  . (A-l 4) 

The  final  form  for  w*(k)  can  be  obtained  by  applying  the  operator, 

Dg(7)  Dg(z-1) 

to  each  side  of  Eq.  (A-l  1)  and  using  Eqs.  (A-10)  and  (A-7b).  The  resulting  expression  for 
w*  (8)  is  given  by 


w*(2)  = Dg(z)Dg(z~1)F*(8)  0 < 2 < L-l  , 


(A- 15a) 


where 


F*(2) 


Z-  m m 

m=l 


+ A"1  (Pg(z'1)Pg(z))~1  0XX(2  + A)  0 < 2 < L-l  . (A- 15b) 

The  expression  for  w*(2)  which  is  obtained  from  Eq.  (A-l 5)  will  contain  the  delta  function 
and  its  differences  at  the  end  points  of  the  interval  0 < 2 < L-l . The  delta  functions  arise  as 
a result  of  applying  the  operator  Dg(z)  Dg(z-h  to  F*(2)  at  the  end  points  8 = 0 and  2 = L-l. 
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Excluding  these  end  point  contributions,  we  havet 


0<  2 < L-l  , 

■ 1 _ 2+j0_2  _ -pm(L-l-2)  +j0m2 

D8(z)De(z-1)dmeMm  J m =BmeHm  m 

0 < 2 < L-l  , 


and 


A"1  Dg(z)  Dj(z-^)  (pgtz-bPelz))"’  «XX(2  + A)  = 0 - 

0 < 2 < L-l  . 


(A-16) 


(A-17) 


(A-18) 


Equation  (A-18)  may  be  verified  by  operating  on  both  sides  of  Eq.  (A-7a)  with  the  operator, 

A-*  Dg(zj  Dg(z-^ ) ( Pg(z-1 ) Pg(z) ) 1 , 
and  using  Eq.  (A-7b)  (with  k = -A). 

Using  Eqs.  (A-1S)  through  (A-18)  and  including  the  delta  function  contributions  at 
the  ends  of  the  interval  0 < k < L-l  (as  discussed  above),  we  "an  write  the  final  expression 
for  w*  (k)  as  (See  References  [16),  chapter  6;  and  [14],  chapter  13.) 


w 


M 

*»)  - 2 

m=l 


B+  e-#imk+jtfmk  + B-  e-**m<L-,-k>+j®mk 


m 


m 


N-M 


^ |c*  6(k-r+l)  + C~  6(k+r-L)J 

r=l 


k = 0, . . . , L-l  . (A-19) 


By  definition,  the  sums  of  the  delta  functions  in  Eq.  (A-19)  vanish  when  N < M.  When  N > 
M,  note  that  N-M  delta  functions  arise  at  either  end  of  the  filter,  w*(k).  As  shown  in  Ap- 
pendix B,  this  will  lead  to  precisely  2N  equations  which  the  2N  constants,  B*  and  C*,  must 
satisfy.  m r 


tin  operating  on  the  functions  on  the  left  hand  sides  of  Eqs.  (A-16)  through  (A-18)  with  Dg(z)  Dg(z-1),  it 
is  tacitly  assumed  that  these  functions  are  extended  outside  the  interval  0 < 2 < L-l , ie.,  we  are  ignoring 
the  end  point  contributions. 
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APPENDIX  B.  DERIVATION  OF  THE  COEFFICIENT 

EQUATIONS  FOR  THE  B*  AND  C* 

m r 

In  order  to  determine  the  constants  Bj^,  cf  which  appear  in  the  expansion  for 
w*(k),  one  substitutes  Eq.  (A-19)  into  Eq.  (A-l).  Before  doing  this,  however,  one  must  first 
develop  an  explicit  form  for  the  autocorrelation  function,  0xx(k),  from  the  relation: 

0xx(k)  = ^ Sxx(z)zk'1dz  k = 0,  ±1,  ±2, . . . , (B-l) 

Izl  = 1 

with  Sxx(z)  given  by  Eq.  (A-2).  As  can  be  seen  from  Eq.  (A-2),  Sxx(z)  is  a rational  func- 
tion of  z with  poles  inside  and  outside  the  unit  circle.  Therefore,  Eq.  (B-l)  can  be  simply 
evaluated  as  the  sum  of  the  various  pole  contributions  of  zk-l  Sxx(z)  which  are  inside  the 
unit  circle,  i.e., 

0xx(k)  - l Ane-nlk,+J"nk  for  k>0,  (B-2a) 

n=l 


and 


N 


t a-an\W+io>nk 


^xx^  ^ ^ne 
n=l 

In  Eq.  (B-2),  An  is  given  by: 

(-an+j^nHN-M-1) 

A = — : 

n ^n  +JU)n  “n+Jwn 


for 


k < 0 . 


(B-2b) 


PJ  (e^n+jwn_e^m+j°m)(  e““n  + j‘->n  _ /m  +i°m) 

m=l 
N 


(B-3a) 


n(«^  + i<*>n_jf“B+jw8)  (e-“n+jwn.e°8+jwB  ) 


8=1 

8#n 


where  B is  given  by 
B = (-1)M* 


F M / N 

* n«-Wn 

[_m=l  / n=l 


."^n  “ JCJn 


A , 


(B-3b) 


and  A is  defined  by  Eq.  (A-2).  In  deriving  the  expansion  for  0xx(k)  given  by  Eq.  (B-2),  it 
has  been  tacitly  assumed  that  M < N.  When  M ^ N then  Eq.  (B-2)  must  be  modified  to 
include  a linear  combination  of  the  delta  functions:  6(k),  5(k±  1), . . . , 6(k±(M-N)). 
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Substituting  Eq.  (A-19)  for  w*(k)  into  Eq.  (A-l)  with  0xx(k)  given  by  Eq.  (B-2) 
leads  to  the  following  equation: 


M N 

2 2 

m=  1 n=  1 


m+»n. 

m 


[t an  "Jwn 

An  e 


A e°'"'J‘Jn  1 u 

An  e “K 

j _ e“n  ~ ~^wn  ~ 


*B'  e'^a'1)e'‘"1+i#m 


m 


r 


t fUn'i^n 


Ane“n-jWn  1 
, _ean  + ^m-Hwn-0m)J 


e-«n+%-jK-em) 
/mc+j0mc 


t -anL-jcOnLf  BmC 
~An  -an- 

. 1 - e n 


, BmC  e“nC+JwnC 

i ."^n  + ~ j^n  “ 


1 - e 

N-M  N 

♦ 2 2 

r=l  n=l 


+ -<Kn|C-r+l|  + ja>n(£-r+l) 

C Jn(C-r+l)e  n n 


+ <TJn(fi-L+r)e 
N 

= S Ane 

n=l 


-an|£-L+r|  + jwn(£-L+r) 


'“nA+jwnAe-an£+i‘*,n£ 


£ = 0 L-l 


(B-4) 
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f 


In  Eq.  (B-4),  Jn(2)  is  defined  by 
Jn(C)  s An,  o<e 

and 

Jn(C)  = An,  fi<0. 

As  noted  above,  it  is  tacitly  assumed  for  the  present  that  N > M.  The  case  N = M will  be 
subsequently  discussed  and  the  case  N < M can  be  treated  by  a straightforward  extension  of 
the  methods  discussed  here. 

Equation  (B-4)  may  be  simplified  considerably  by  first  noting  that  the  coefficients  i 

multiplying  the  exponentials,  exp(±  /imC  + jdmfi),  must  vanish,  i.e., 


-a  |£-r+l|+ju>n(£-r+l) 
Jn(fi-r+l)e  n n 

-an(£-r+ 1)  + jcon(£-r+  1) 

- An  e 


2 

p=i 


A„  e ' nP  ) 5(C-r+ 1 +p) 


P ~JwnP  __  A 

n 


0<£<L-1  , 


(B-7a) 


and 


Jn(£+r-L)  e 


-c*n|£+r-L|  +joun(£+r-L) 


An  e 


r-1 


ja>n(£+r-L)  + <*n(£+r-L) 


2 (a„  e"“"P  ,i“’"P  - A0  e“"P  * j""P)  6<fi+r-L-p) 

p=0 


0 < £ < L-l  . 


(B-7b) 


The  summation  appearing  in  Eq.  (B-7a)  vanishes,  by  definition,  when  r=  1.  Substituting  Eq. 
(B-7)  into  Eq.  (B-4)  gives  rise  to  terms  involving  the  delta  functions  which  appear  on  the 
right  hand  side  of  Eq.  (B-7).  Specifically,  these  terms  are  given  by: 


N-M  r-1  N . 

2 <2  ««-'♦!♦«  2 An=-"p-’“"p-Ane“"p-j“"p) 

r=  1 p=l 


N 

2 

n=  1 


0 < £ < L-l  , 


(B-8a) 


and 


I c;  2 «(«+r-L-p)  l (An^P+i“"P-A„e“»pti“"P) 

r=l  p=0 


n=  1 


0 < £ < L-l  . 


(B-8b) 


It  is  now  shown  that  Eqs.  (B-8a)  and  (B-8b)  vanish.  To  show  this,  we  will  show, 
equivalently,  that: 


f A„e°,"P*i""p 

n=l 


N 

2 

n=l 


0 < p < N-M-l  . (B-9) 
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Equation  (B-9)  can  be  established  by  a conventional  residue  argument.  Note  from  Eqs. 
(B-2)  and  (A-2)  that  for  p > 0: 


N 

S*» 


-«np+jWnP 


n=  1 


f dzzP+N-M-' 


|z|=  1 
M 


J-J  -e-^m +^m)  ( 2 _ e^m +^m  ) 
m=l  


n=l 


(B-l  0) 


The  constant,  B,  in  Eq.  (B-l 0)  is  given  by  Eq.  (B-3b).  The  integral  in  Eq.  (B-l 0)  over  the 
unit  circle  is  equal  to  an  integral  over  a large  circle  |z|  = R (R  > max  (ean))  minus  the  resi- 
due contributions  at  zn  = exp(an  + jcjn).  However,  when  0 < p < N-M-l , the  integral  over 
the  large  circle  vanishes  (which  can  be  seen  by  letting  (R  -*■  °°))  and  the  only  contributions 
to  the  integral  in  Eq.  (B-10)  are  the  residue  contributions  at  zn  = exp(an  + jcun).  However, 
these  contributions  give,  precisely,  the  right  hand  side  of  Eq.  (B-9)  and  therefore,  Eq.  (B-9) 
is  established. 

Substituting  Eqs.  (B-5)  and  (B-7)  into  Eq.  (B-4)  and  using  the  result  given  by  Eq. 
(B-9)  leads  to  the  following  relations: 


N M 

S II 

n=  1 m=l 


r B 

^ m 

| _ ean  ~ ^m  ~ j^tJn-^m* 

Bme  ] e-“ne+jwn* 

_ “n  + ^m-j(wn-^m)J 


1 - e 


T <fanL-j‘‘>nL 
_ An  e 


B+  e“^mL  + jtfmL 
m 


1 - e 


-an -%r-j<wn 


B e 
m 


Mm+j%L 


1 - e 


-“n  + Mm-i^n-^m) 


«nfi+Mi£ 
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+ 


N-M  N 

II 


r=  1 n=l 


C+Ane'“n(8~r+I)+J<°n(8"r+1) 


+ C~  An  e“n  (C+r*L)  + i“n<*+r-L> 


N 


- I An 
n=l 

0<8<L-1  . 


-«n(A+C)  + jcjn(A+C) 


(B-l  1) 


The  constants  and  C*  can  now  be  determined  by  equating  coefficients  of  the 
exponentials,  exp(±an£  + jwnE),  in  Eq.  (B-l  1).  The  desired  relations  for  the  B^,  C*  are 
given  by: 


and 


M 

I 

m=l 


B„ 


m 


_ -um(L-l) 
B e m 
m 


j _ e“n  -^m  -j^n-^m)  j _e«n  + Mm -J(Mn-*n,5 

+ ^ C+  ean  (r~  1 ) - j wn  (r- 1 ) = e-«nA+jwnA 
r=  1 

n = 1, . . . , N , 


M 

I 

m=l 


B e 
m 


B e 
m 


Mm+jymL 


1 -e 


-an-Mm-J^n^m)  , _e-“n  + **m  -j<wn-*m> 


N-M 

- j c;eanr  + Ja,nr  = 0 

r=l 


n = 1 , . . . , N 


tB-12a) 


(B-12b) 


Equations  (B-1 2a)  and  (B-12b)  are  valid  when  M < N.  The  only  modification  which  is 
needed  when  M = N is  to  remove  the  summation  terms  involving  the  Cjr  in  Eqs.  (B-l 2a)  and 
(B-l 2b).  That  is,  when  M = N only  damped  exponentials  appear  in  the  analytic  solution  for 
the  LPF  coefficients.  It  should  be  pointed  out  that  £q.  (B-l 2)  was  originally  presented  in 
Reference  [221  without  derivations.  Also,  analogous  equations  to  Eq.  (B-l  2)  appear  in  the 
treatment  of  the  continuous  problem  and  a more  complete  analytical  discussion  of  equa- 
tions similar  to  Eq.  (B-l  2)  is  given  in  Reference  [25 1 , Chapter  8. 
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APPENDIX  C.  DEVELOPMENT  OF  APPROXIMATE  POLE-ZERO  MODELS 
FOR  NARROWBAND  PROCESSES  IN  ADDITIVE  BROADBAND  NOISE 

In  this  Appendix,  approximate  rational  spectrum  models  will  be  developed  for  nar- 
rowband processes  embedded  in  additive  broadband  noise.  The  cases  of  additive  uncorrelat 
ed  and  additive  correlated  noise  will  be  analyzed  in  parts  1 and  2,  respectively. 


1.  NARROWBAND  PROCESSES  EMBEDDED  IN  ADDITIVE  UNCORRELATED  NOISE+ 

For  this  class  of  inputs,  the  autocorrelation  function  may  be  expressed  as 

0xx(k)  = *no<k>  + *s<k>  * (C-!) 

where  0no(k)  and  0S( k)  represent  the  autocorrelation  functions  of  the  noise  and  signal, 
respectively.  As  discussed  in  Section  111,  the  form  of  0s(k)  which  will  be  considered  here  is 
given  by: 


0s(k)  = ^ e"0*11^  cos  conk  , 

n=l 


(C-2) 


2 

where  o„,  a,,,  and  wn  rePresent  the  power,  3-dB  half  bandwidth,  and  frequency,  respective- 
ly, of  the  n™  signal.  For  uncorrelated  noise,  the  autocorrelation  function  of  the  noise  is 
given  by : 


«no(k)  = °no6(k)  ’ 


(C-3) 


where  represents  the  noise  power. 

The  model  represented  by  Eq.  (C-l)  is  a mixed  autoregressive-moving  average 
( ARMA)  model  with  2N  AR  terms  and  2N  MA  terms.  The  z-transform  of  0xx(k)  is  given 

by: 

2 ^ e***11  sinh  c*n 

„4,  ( z -e*0"1  +iWn) 


= a 


2N 

3 - 2 


2 iwn  • u 
a e " sinh  an 
n 11 


no 


- a2  J£i 
ano  2N 

n 

n=l 


f]  L.-A+)*»)(,-A+J*») 

n=l 


(C-4) 


^The  material  preaented  in  this  section  was  originally  presented  in  Reference  (33) . 
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In  (C-4), 


an+N 


= a. 


for 


n=  1 N , 


(C-5a) 


and 


Wn+N 


= ~Oir 


for 


n = 1, . . . , N . 


(C-5b) 


As  can  be  seen  from  Eq.  (C-4),  Sxx(z)  can  be  represented  as  a product  of  two  factors.  The 
first,  OpQ,  represents  the  flat  power  spectral  density  of  the  background  uncorrelated  noise. 
The  second  factor,  Q(z),  is  a rational  function  of  z with  poles  located  at  the  signal  poles, 
exp(±an  + jwn).  The  zeroes  of  Q(z),  exp  (±0n  + j0n),  may  obtained  by  factoring  Sxx(z) 
in  Eq.  (C-4).  In  general,  such  a factorization  of  the  spectrum  is  analytically  tractable  only 
for  small  values  of  N and  does  not  provide  much  insight  into  the  analytical  structure  of  the 
zeroes  of  Q(z).  However,  as  the  signal  3-dB  half  bandwidths,  an,  all  become  small  enough 
so  that  the  background  noise  spectral  density,  oj"0,  may  be  closely  approximated  from 
Sxx(elw)  between  the  signal  frequencies  (i.e.,  no  appreciable  overlap  of  signal  spectra),^ 
then  a simple  approximating  expression  for  the  zeroes  of  Q(z)  may  be  derived. 

The  assumption  that  the  background  noise  may  be  closely  approximated  from 
Sxx<eJw)  is  consistent  with  requiring  that  the  poles  and  zeroes  of  Q(z)  occur  in  pairs,  i.e., 


{ e‘an+j‘°n) 


and 


l 


0n+j*n  “n+iwn 


n = 1, 


n = 1, 


2N 


2N 


(C-6a) 


(C-6b) 


and  that  the  distance  between  each  member  of  the  pair  in  Eq.  (C-6)  is  very  small. 

Making  this  assumption,  we  can  now  obtain  an  approximate  expression  for  the 
zeroes  of  Q(z).  From  Eqs.  (C-l ) and  (C-4),  we  have: 


*xx<k>  = 2in  $ °noQ(z)zk_1 


dz 


|z|=l 


Using  Eq.  (C-6)  we  obtain  the  following  expression  for  0xx(k): 


*xx<k>  * ° 


2N  / -<*n+jG>n  -0n+i*n)  ( ^n+j^n  /n+j*n) 

Q(0) 5(k)  + \ e Zl L 

L e^n+J^n_e“n+^n 

Qn(e-°'n+jWn)  e-“n<k-,>+jwn(k'D 


k > 0 


(C-7) 


'Note  that  no  appreciable  signal  spectra  overlap  also  implies  that  the  signal  frequencies,  wn, are  sufficiently 
greater  than  zero  so  that  there  is  no  overlap  between  the  positive  and  negative  frequency  components  of 
the  signals. 
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- ..  V - ■ - - 

- - ‘ ' ■ ' ' . 


(C-8) 


In  Eq.  (C-7),  Qn(z)  is  defined  as 


Qn(z) 


pr  (z-e~fy+jM(z-e^*j*g) 

U (z-e^+jWfi)(  z-e"«+jW«)  ' 
£^n 


Under  the  assumptions  of  small  an,  and  little  signal  overlap,  we  have  approximately  that 
Q(0) = 1 and 


(C-9) 


Therefore,  equating  Eqs.  (C-7)  and  (C-l ) and  using  Eq.  (C-9),  we  obtain  the  following  ap- 
proximations for(?n  and  ^n: 


\l/n  = con  , n = 1 , . . . , 2N  , (C-lOa) 

Pn  = cosh-*  | cosh  «n +ySNRn  sinh  an  | , 

and 

0n+N  = 0n  for  n=l , . . . , N . (C-lOb) 

In  Eq,  (C-l  0),  SNRn  = is  the  signal-to-noise  ratio  of  the  n1*1  signal. 

Equation  (C-10)  shows  that  in  the  limit  of  small  signal  bandwidths,  the  zeroes  of 
Q(z)  are  displaced  slightly  back  along  radial  lines  from  the  signal  pole  locations.  As  the 
an  -*■  0,  both  the  zeroes  and  the  poles  approach  the  unit  circle.  This  implies  that  in  the 
limit  of  zero  signal  bandwidths  (i.e.,  sinusoids  in  white  noise)  the  appropriate  time  series 
model  for  the  process  represented  by  Eq.  (C-l ) is  an  ARMA  model  of  order  (2N,  2N)  with 
identical  AR  and  MA  terms.  This  limiting  result  was  also  derived  using  a difference  equation 
approach  in  Reference  [32] . 


The  approximations  expressed  by  Eq.  (C-10)  become  increasingly  accurate  as  the 
distance  between  each  member  of  the  pole-zero  pair  in  Eq.  (C-6)  becomes  small,  i.e.,  when 

cosh-*  | cosh  an  +-jSNRn  sinh  an  j -«n  0 . (C-l  la) 

For  small  an  (with  SNRn  fixed),  Eq.  (C-l  la)  reduces  to  (from  Eq.  (15)) 

J SNRn  an  * 0 . (C-l  lb) 


Vice  versa,  for  small  SNRn  (with  an  fixed)  Eq.  (C-l  la)  reduces  to  (from  Eq.  ( 14)) 

SNRn/2  * 0 . (C-l  1c) 

Note  that  the  actual  values  of  the  differences,  (3n  - an,  which  are  required  for  a desired 
accuracy  of  the  approximations  given  by  Eq.  (C-10)  will  depend  on  the  frequency  separa- 
tions of  the  signals.  This  is  because  for  fixed  values  of  an  and  0n,  the  approximation  ex- 
pressed by  Eq.  (C-9)  will  become  worse  as  the  signal  frequency  separations  decrease,  as  is 
seen  from  Eq.  (C-8).  In  this  case,  there  will  be  appreciable  signal  spectra  overlap  and  the 
approximations  expressed  by  Eq.  (C-10)  will  become  invalid. 
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2.  NARROWBAND  PROCESSES  EMBEDDED  IN  ADDITIVE  CORRELATED  NOISE 

In  this  section,  we  will  assume  that  the  z-transform  of  the  autocorrelation  function 
of  the  input,  Sxx(z),  can  be  represented  as  follows: 

Sxx(z)  = Sno(z)  + Ss(z)  , (C-12) 

where  Sno(z)  is  the  z-transform  of  the  noise  autocorrelation  function.  As  discussed  in 
Section  III,  it  will  be  assumed  that  Sno(z)  can  be  expressed  as  a rational  function  of  z: 


e / x _ 2 m=l 

Sno<z)  ano  Nq 


n(~ 


-^m+jtfm 


) ( z_1  - 


(C-13) 


f]  (z-e^  + ^n)(z-l.-n-i-n) 


where  a2  , u'  and  a'  are  non-zero,  positive  real  constants  and 
no  m n 

-7T  < OJ^,  0'm  < 7T  , for  all  m,n  . 

Also,  in  Eq.  (C-12)  Ss(z)  represents  the  z-transform  of  the  signal  autocorrelation  function 
and  can  be  obtained  from  Eq.  (C-4),  i.e., 


2N 

V*>  - 2 


“t«n 

e 11  sinh  an  o~ 


n=l  (z~ 


^n  + Jwn 


-1  „-“n-Jwn' 


(C-14) 


Based  on  the  discussion  presented  in  Section  C-l,  it  is  expected  that  a reasonable 
approximation  for  Sxx(z)  under  the  assumption  of  small  an  (little  signal  overlap)  will  be 
given  by: 


^xx^  — ^ 


,(z)  Q(z) 


(C-l  5) 


Equation  (C-l  5)  is  directly  analogous  to  Eq.  (C-4)  with  ono  replaced  by  Sno(z).  Also,  the 
function  Q(z)  in  Eq.  (C-l 5)  is  assumed  to  be  represented  by  a rational  function  of  z as  in 
Eq.  (C-4)  with  2N  poles  located  at  the  signal  poles,  exp(±an  + jwn),  and  2N  zeroes  which 
are  represented  by  exp(±0n  + j^n).  Equation  (C-15)  implies  that  the  input  process  can  be 
approximated  by  an  ARM  A process  with  2N  + M0  zeroes  and  2N  + N0  poles.  It  is  impor- 
tant to  point  out  that  this  is  only  an  approximation  since  the  order  of  the  exact  ARMA 
model  which  represents  the  input  process  will,  in  general,  be  different  (as  can  be  seen  from 
Eqs.  (C-12)  through  (C-14)).  However,  as  the  crn  -*•  0,  Eq.  (C-l  5)  will  provide  an  increasing- 
ly accurate  model  as  will  be  shown  below. 


if' 

*, 

V. 

} 


* 


I 


Carrying  out  the  integral  evaluation  for  0xx(k)  as  in  Eq.  (C-7)  with  Sxx(z)  given  by 
Eq.  (C-15)  gives: 

^xx(k)  *2 ij  $ Sno<z>  zk_1  dz 
|zl=l 

e^n+j^n_eA+^n)  ( e^n  + J“n  . /n  + i*n) 
e-«n+Jwn_e“n+j"n 

•Qn  (e^+jW")  Sno(e^"  + jWn)  H*n +J“n>  (k-»> 

k>0  . (C-16) 

In  Eq.  (C-16),  Qn(z)  is  defined  as  in  Eq.  (C-8)  and  0no(k)  represents  the  contribution  to 
the  integral  which  arises  from  the  poles  of  the  function  zk~l  Sno(z).  Assuming  that  these 
poles  are  sufficiently  separated  from  the  signal  poles  so  that  Q(0)  38  1 and 

Q (e"a‘1  + JW'1)  **  1 n = 1 N0>*  (C-17) 

then  0no(k)  will  approximately  equal  the  true  autocorrelation  function  of  the  noise, 

0no(k).  Also,  it  is  seen  that  the  contribution  from  the  signal  poles  in  Eq.  (C-16)  is  practical- 
ly identical  to  that  for  the  white  noise  case  (see  Eq.  (C-7)).  Their  main  difference  is  the 
factor,  Snofe-®”  + ■>a’n),  in  Eq.  (C-l  6).  This  quantity  can  be  approximated  for  small  an  as 
follows: 

*Sno(ci“») 

(C-l  8) 


1 -ane 


JO). 


2N  ( 

- ♦„<,«+  i - 

n=l 


Therefore,  provided 

then  an  approximation  for  the  0n  and  0n  can  be  obtained  in  direct  analogy  with  Eq.  (C- 10), 

i.e., 

0n  = (dn  , n = 1 , . . . , 2N  , (C-20a) 

Pn  “cosh'1  jcoshan  + ^SNRnSinhanJ  , 
and 

0n+N  * 0„  for  n * 1 N • (C-20b) 

In  Eq.  (C-20),  SNRn  = o^/Sno(^Wn)  and  is  the  signal-to-noise  spectral  density  ratio 
at  the  nth  signal.  Note  that  Eq.  (C-19)  will  be  satisfied  either  in  the  limit  of  small  signal 
bandwidths  or  provided  the  background  noise  spectral  density  is  not  varying  too  rapidly  in 
the  vicinity  of  the  signal.  If  this  is  not  the  case,  then  the  signal  zeroes,  exp(±0n  + j0n),  will 
not,  in  general,  lie  on  the  same  radials  as  the  signal  poles. 
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APPENDIX  D.  TREATMENT  OF  THE  COEFFICIENT  EQUATIONS  FOR 
NARROWBAND  PROCESSES  EMBEDDED  IN  BROADBAND  NOISE 

In  this  Appendix,  the  coefficient  Eqs.  (5)  and  (6)  will  be  analyzed  for  inputs  consist- 
ing of  narrowband  signal  processes  embedded  in  additive  broadband  noise.  It  will  be  as- 
sumed, as  in  Section  III,  that  the  autocorrelation  function  of  the  input  is  given  by  Eq.  ( 10), 
the  z-transform  of  the  noise  autocorrelation  function  is  given  by  Eq.  (1 1),  and  the  zeroes  of 
Sxx(z)  are  approximated  by  Eq.  (13).  The  impulse  response  of  the  discrete  LPF  will  be 
expressed  as  follows: 

w*(k)  = hs(k)  + hno(k) 

where  hs(k)  is  given  by 
2N 

hs(k)  - ]£ 

n=l 

and  hno(k)  is  given  by 


k = 0,  1, . . . , L-l 


B 


+s  e-0nk  + jwnk  + B_s  e-0n(L-l-k)  + joJnk 


(D-l) 


(D-2) 


M, 


hno(k) 


-I 

m=l 


+0  -Knk+i0mk 


B - e 

m 


+ B“°e 
m 


-Mm(L-l-k)+j^k 


N0'M0 


I 

r=l 


C+°  6(k-r+ 1)  + C"°  5(k+r-L) 


(D-3) 


The  constants  B~s,  B^,  and  C~®  can  be  determined  from  the  coefficient  Eqs.  (5)  and  (6). 
A general  treatment  of  these  equations  is  quite  involved  when  there  is  appreciable  coupling 
between  the  different  signal  amplitudes,  B*s.  However,  when  all  of  the  signal  bandwidths 
are  quite  small  and  provided  L is  large  enough,  some  useful  approximations  for  the  B*s  can 
be  obtained.  In  this  Appendix,  we  will  treat  Eqs.  (5)  and  (6)  under  two  limiting  ap- 
proximations. First,  we  will  consider  the  limit  of  large  L such  that 


L>  1 lti'm  , m = 1, . . . , M0 
and 

L>  l/0n  , n * 1, . . . , 2N  . 

Then,  we  will  consider  the  limit  of  small  signal  bandwidths  such  that 
0n  *<  1/L  for  all  n = 1 ....  , 2N  . 


(D-4a) 


(D-4b) 


(D-5) 
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LIMIT  OF  LARGE  L 

As  discussed  in  Section  II,  as  L -*■  °°  so  that  Eq.  (D-4)  is  valid,  all  of  the  reflection 
amplitudes-B^,  and  approach  zero.  From  Eq.  (5)  it  is  seen  that  in  this  limiting 
case,  the  B„  satisfy 


B 

( 

1 - e 


ft+s  2N 

j__+  y 

<*n-Pn  £ , «n- 


B 


+s 

m 


m=  1 1 ~ e 
m#n 


0m  *j(wn*wm^ 


Mr 


l—i 


B 


+0 

m 


= 1 1 -e 


m 


N0-M0 


n “^m  "j^wn  ~^m^ 


2 < 


+0  ofn(r-I ) -jcon(r-l)  = e-anA+jwnA 


r=l 


n = 1, . . . , 2N  , 


(D-6) 


where  in  Eq.  (D-6),  an+N  = an  (n  = 1 , . . . , N).  When  the  differences,  0n  - an>  are  al1  verV 
small,  then  we  can  make  the  approximation: 


1 - e**11  **  0n  - an  < 1 


n = 1 2N 


(D-7) 


As  seen  from  Eqs.  ( 1 3)  through  ( 1 5),  Eq.  (D-7)  becomes  valid  either  in  the  limit  of  small 
signal  bandwidths  or  small  SNRn.  Also,  provided  the  signals  are  all  separated  far  enough 
apart  in  frequency  so  that: 


for  n,  m = 1 , . . . , 2N  (n  # m)  , 


(D-8) 


,+s  . 


then  the  coefficient  matrix  which  multiplies  the  column  vector  with  components  Bn  in  Eq. 
(D-6)  becomes  approximately  diagonal.  Under  this  approximation,  the  coupling  between 
the  B-^  in  Eq.  (D-6)  vanishes  and  we  have  the  following  approximation: 


K*  * <fln'-«n> 


-anA  + j*>nA 


Mo  b+0 

V JL 

/ ■ Ot"  - itL.  - j(CJr%  “ flL*) 

m=l  1 e 


N0-M0 
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r»l 


+0  an(r-l)-jwn(r-l) ! 
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n = 1 , . . . , 2N  . 


(D-9) 
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We  now  examine  the  additional  relations  which  the  and  must  obey  (from 


Eq.  (5)  with  L-*  °°): 


d=l  1 - e 


“n  -j(wn  -^m) 


N0'M0 


I < 


,+0  e“n(r-D  - jco^(r-l) 


V OL 

i l Pan  “ ^m  " j<tJn  “ wm^ 
m=l  1 ~ e 


= e^nA+JwnA 


n 1 > • • • » Nq  . 


(D-10) 


Equation  (D-10)  shows  that  provided  the  background  noise  is  decorrelated,  i.e., 

e"**11^  *»  0 , for  all  n = 1, . . . , NQ  , (D-l  I) 

then  the  constants  B*0  and  C*  0 will  be  linearly  related  to  the  amplitudes,  B^.  By  substi- 
tuting Eq.  (D-9)  into  Eq.  (D-10)  for  the  B^  it  is  seen  that  the  constantsBj~  and  C*°  are  of 
order  (0n  - an)  for  small  values  of  (0n  - an).  Therefore,  if  there  is  little  signal  decorrelation, 
i.e., 


e~°‘n  ^ * 1 , for  all  n = 1, . . . , N , 
and  provided  Eq.  (D-7)  holds,  then  from  Eq.  (D-9)  it  is  seen  that: 


+s  -o(n  A + jcjn  A 

BnS-(0n~«n)e  " 


n = 1 2N  . 


(D-l  2) 


(D-l  3) 


Equation  (D-l 3)  is  the  desired  approximation  for  the  Bn  in  the  limit  of  large  L. 


LIMIT  OF  SMALL  SIGNAL  BANDWIDTHS 

As  can  be  seen  from  Eq.  (D-2),  as  0n  L -*•  0,  hs(k)  is  approximately  given  by 


h,(k)  a £ (Anei“"k-GAkeJ“"k  ) 


where 


An  - 


0<  k < L-l  , 


(D-14a) 


(D-  14b) 
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and 


(D-14c) 


As  will  be  shown  below,  the  Gn  in  Eq.  (D-14a)  will  approach  zero  as  the  an  approach  zero. 
The  method  which  is  used  in  this  section  for  analyzing  Eqs.  (5)  and  (6)  consists  of  separat- 
ing the  2N  + N0  equations  in  Eq.  (5)  and  the  2N  + N0  equations  in  Eq.  (6)  into  2N  equa- 
tions for  the  amplitudes,  An,  and  2N0  equations  for  the  amplitudes  and  C*  . As  will 
be  seen,  these  two  sets  of  equations  will  be  coupled  together  in  analogy  with  Eqs.  (D-6)  and 
(D-10). 


Using  Eqs.  (D-14b)  and  (D-14c)  in  the  coefficient  Eqs.  (5)  and  (6),  we  can  express 
the  equations  for  the  B±s  in  terms  of  the  An  and  Gn  (in  the  limit  as  all  of  the  0n  L -*■  0):^ 
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n = 1 2N  , 
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(D-15a) 


t In  deriving  Eq.  (D-l  5)  we  assume  that  0„Lis  small  enough  that  exp( i0nL)  * 1 L.  Also,  the  products 
a„0„  are  neglected  in  comparison  with  the  terms  fr  (which  is  valid  as  an  -*  0 (see  Eq.  (15)). 
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(D-15b) 


Notice  that  the  Gm  terms  which  appear  in  the  summations  in  Eq.  (D-l  5)  are  all  multiplied 
by  the  0m  (which  approach  zero  as  am  approaches  zero).  Notice  also  that  the  term, 


{ 2ft, -5  <1-1  >, 

2G"  >"«2 

rn  n 


appears  on  the  left  hand  sides  of  Eqs.  (D-l  5a)  and  (D-l  5b).  Transposing  this  term  to  the 
right  hand  side  of  Eq.  (D-l  5b),  substituting  the  result  into  Eq.  (D-l  5a),  and  letting  the 
an  -*•  0 (with  the  0n  approximated  by  Eq.  (15))  results  in  the  following  limiting  equations 
for  the  An  (which  are  independent  of  the  Gn,  0n , and  an): 
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Additional  equations  for  the  B^,  Cr^,  and  the  An  can  be  obtained  from  the  2N0  equations 
of  Eqs.  (5)  and  (6)  that  involve  the  noise  poles.  These  equations  are  as  follows  (in  the  limit 
as  the  an  -*•  0): 
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Note  that  Eqs.  (D-16)  through  (D-18)  show  that  as  the  signal  bandwidths,  an,  ap- 
proach zero,  the  An,  Bjij,0,  and  Cf°  all  become  independent  of  the  an.  Therefore,  from  Eq. 
(D-l  5b)  it  is  seen  that  the  term, 


( 2@n  - )r  (L-l)j 

I0"5 2 2 1 * Gn<SNRn“n)  1,2  • 

Kn  n 

must  approach  a constant  (independent  of  on)  as  all  of  the  an  approach  zero.  Therefore,  Gn 
approaches  zero  as  an  -*•  0 and  from  Eq.  (D-14)  it  is  seen  that  hs  (k)  is  given  approximately 
by: 


hs(k)  * y AneJ“nk  . 


(D-l  9) 


It  should  be  pointed  out  that  Eqs.  (D-16)  through  (D-18)  could  also  have  been  derived  by 
substituting  Eqs.  (D-l),  (D-3),  and  (D-l 9)  into  Eq.  (1)  and  equating  coefficients  as  discussed 
in  Appendix  B. 
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As  can  be  seen  from  the  left  hand  side  of  Eq.  (D-16),  as  the  quantity  (LSNRn/2+ 1)/ 
(SNRn/2)  becomes  large,  the  coefficient  matrix  which  multiplies  the  column  vector 
with  components  An  in  Eq.  (D-16)  becomes  approximately  diagonal.  Also,  provided  the 
background  noise  is  decorrelated  (D-l  1),  then  the  amplitudes  and  CpO  will  be  linearly 
related  to  the  An,  as  can  be  seen  from  Eqs.  (D- 17)  and  (D-18).  Therefore,  in  analogy  with 
the  treatment  of  Eqs.  (D-9)  and  (D-l 0)  for  large  L,  it  is  seen  from  Eqs.  (D-16)  through 
(D-18)  that: 


SN1W2  jwnA 

An  * l + LSNRn/2  e 


n = 1 , . . . , 2N  . (D-20) 


Note  that  (LSNRn/2  + l)/(SNRn/2)  becomes  large  either  in  the  limit  of  large  L or  small 
SNRn.  Therefore,  in  either  of  these  limits,  Eq.  (D-20)  will  provide  a good  approximation 
for  the  An. 
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